-- Logs begin at Mon 2022-05-16 21:33:55 UTC, end at Mon 2022-05-16 22:39:48 UTC. -- May 16 22:04:24.945478 dv-cinder-842000-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 22:04:24.955372 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 22:04:24 2022] *** May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: nodename: dv-cinder-842000-1-iscsi May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: machine: x86_64 May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: clock source: unix May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: pcre jit disabled May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: detected number of CPU cores: 4 May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: current working directory: / May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: detected binary path: /usr/bin/uwsgi-core May 16 22:04:24.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: your processes number limit is 47680 May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: your memory page size is 4096 bytes May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: detected max file descriptor number: 2048 May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: lock engine: pthread robust mutexes May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: thunder lock: enabled May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 22:04:24.957974 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 22:04:25.003391 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: Python main interpreter initialized at 0x5603a9f1f9c0 May 16 22:04:25.003391 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: python threads support enabled May 16 22:04:25.003391 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: your server socket listen backlog is limited to 100 connections May 16 22:04:25.003391 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: your mercy for graceful operations on workers is 90 seconds May 16 22:04:25.003774 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: mapped 403077 bytes (393 KB) for 2 cores May 16 22:04:25.003843 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: *** Operational MODE: preforking *** May 16 22:04:25.004083 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: *** uWSGI is running in multiple interpreter mode *** May 16 22:04:25.004083 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: spawned uWSGI master process (pid: 79832) May 16 22:04:25.004292 dv-cinder-842000-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 22:04:25.005236 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: spawned uWSGI worker 1 (pid: 79844, cores: 1) May 16 22:04:25.009227 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: spawned uWSGI worker 2 (pid: 79845, cores: 1) May 16 22:04:25.009227 dv-cinder-842000-1-iscsi devstack@keystone.service[79832]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 22:04:30.723053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:04:30.723053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: from cryptography.utils import int_from_bytes May 16 22:04:30.724374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:04:30.724374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: from cryptography.utils import int_from_bytes May 16 22:04:30.728593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:04:30.728593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: from cryptography.utils import int_from_bytes May 16 22:04:30.729989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 22:04:30.729989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: from cryptography.utils import int_from_bytes May 16 22:04:30.774318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:04:30.774521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:04:30.774719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] command line args: [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:04:30.774963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:04:30.775139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ================================================================================ {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:04:30.775397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] admin_token = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.775642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] config_dir = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.775829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.776013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] config_source = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.776190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] debug = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.776391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.790922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 22:04:30.790985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_config_append = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 22:04:30.791107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] command line args: [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 22:04:30.791230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_dir = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_file = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 22:04:30.791335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ================================================================================ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 22:04:30.791466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] admin_token = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_dir = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] config_source = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.791949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] debug = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_config_append = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.792989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_dir = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] publish_errors = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.793925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] standard_threads = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.794969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] use_journal = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] use_json = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] use_stderr = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] use_syslog = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.795782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] publish_errors = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.795916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.795987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] standard_threads = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.796906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.796906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.797024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.797096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_journal = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.797180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_json = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.805338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_stderr = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.805461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] use_syslog = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.805597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 22:04:30.805787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.805973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.806989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.807997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.808963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.809991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.810970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811695 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.811939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.812982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.813094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.813094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.815945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.816623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.819693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.819833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.819966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.820956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.821086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.822220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.822437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.822671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.822866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.823061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.823250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.823472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.823677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.823861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.824077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.824281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.824471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.824663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.824891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.825085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.825291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.825483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.825706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.825898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.826098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.826407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.826407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.827426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.827426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.827673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.827833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.827973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.828511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.828658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.828788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.828916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.external = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.829915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.830051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.830203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.830844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.password = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.831554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.831690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] auth.token = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.831820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.834319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.834469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.834602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.834734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.834870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.835007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.835135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.837285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.837470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.837612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.837747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.837880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.external = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.838920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.password = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.839825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] auth.token = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.840986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.841944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.842081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.842210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.842336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.842490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.843929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.844973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.845889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.846936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.847984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.848892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.849963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.850873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.851900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.852956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.853922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.854838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.855873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.856932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.857996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.858922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.859966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.860995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.861932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.862973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.863898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.864935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.865892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.866954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.867981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.868888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.869940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.870923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] role.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.871953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] role.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.872997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.873865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.874915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.875965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.876992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.877947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.878976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.879766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.880908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.881984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.882894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.883929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.884974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.885992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.connection = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.886925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.887874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.888961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.889094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.889246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.889904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.890960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.891738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 22:04:30.892860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 22:04:30.893965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.893965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.893965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.894990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.895227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.895459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.901096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.904229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.929725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.929955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.930887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.931122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.983890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:30.984161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.036264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.036543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.036802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.037045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.102517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.102772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.102913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.103896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.104028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.104028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.127419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.127622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.127845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.128977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.129108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.129270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.129270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.140954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.141273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.156922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.157874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79844) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.158024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.158024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79845) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 22:04:31.175465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.175675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 22:04:31.175952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.176112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.176253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 22:04:31.176404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 22:04:31.176543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.176678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.176678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 22:04:31.176946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.177789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.188139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.188414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.188683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.188829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.188982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.189288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.189513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.197027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.197638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.200312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.200592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.200875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.201196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.201958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.202956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.203092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.203229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.203374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.203521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.203743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.230119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.230623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.231734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.232014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.232233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.232514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.237947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.238183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.238405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.238561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.238702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.238953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.245752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.246031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.246290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.246588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.251668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.251959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.252247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.252535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.252814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.253093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.253389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.253664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.256248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.256535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.256821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.257104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.257408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.257680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.257946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.258211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.277421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.277698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.277943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.278264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.282212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.282850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.285818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.286111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.286524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.286823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.291051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.291842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.294638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.295475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.298384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.298687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.298972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.299259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.299402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.299630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.299772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.299920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.300057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.300193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.300387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.300669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.319137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.319510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.319781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.320044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.320189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.320484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.320757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.321027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.328527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.329535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.330271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.330550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.331262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.331541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.333596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.333873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.334159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.334450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.334592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.334730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.334880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.335144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.335435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.335718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.348115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.348393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.348672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.348963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.349279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.349989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.350233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.350522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.350802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.369033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.372353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.372482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.376380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.376521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.378069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.379730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.380231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.380315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.380560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.382041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.383746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.384088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.384447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.388106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.390302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.392740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.393575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.393870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.394157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.394439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.394677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.397943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.398295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.398639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.398986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.403681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.403988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.404275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.408437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.408800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.409140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.412258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79845) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.412541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.412826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.413105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.413415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.413704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.413983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.414266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.414539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.414808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.415080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.415361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.415638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.415900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79845) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.417979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79844) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 22:04:31.418322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.418664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.419002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.419345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.419688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.420024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.420393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.420723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.421051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.421402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.421737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.422071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.422391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79844) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 22:04:31.455688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a9f1f9c0 pid: 79845 (default app) May 16 22:04:31.459076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313242-6d3c-4aac-8cb6-04485ecaa336 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:31.459376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313242-6d3c-4aac-8cb6-04485ecaa336 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:31.459666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313242-6d3c-4aac-8cb6-04485ecaa336 None None] PATH_INFO: `/v3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:31.462571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a9f1f9c0 pid: 79844 (default app) May 16 22:04:31.463915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon May 16 22:04:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:39.404742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:39.405327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:39.405327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:39.409654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:39.414799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:39.415225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:39.415359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:39.445851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG oslo_db.sqlalchemy.engines [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:04:39.629155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG passlib.handlers.bcrypt [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79845) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 22:04:39.629597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG passlib.handlers.bcrypt [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79845) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 22:04:39.687087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:39.688723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:39.811694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 22:04:39.958682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:39.992231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG oslo_db.sqlalchemy.engines [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 22:04:40.118516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeff39-b9fa-4962-9c08-fa4ab2cd5fc0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:40.122825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:40.123981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:40.124277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:40.124556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:40.132938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:40.183443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 22:04:40.183788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f723-9b82-4ffe-8a65-c2e0d2ee3bb6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:40.193709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon May 16 22:04:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 22:04:40.199496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:40.214303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb726-9e28-4663-8d25-f8db85dd372d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:40.218683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:40.219784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:40.220073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:40.220350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] PATH_INFO: `/v3/projects/8d531649a1e149a58421310daa30d4f0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:40.221880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] RBAC: Authorizing `identity:get_project(project_id=8d531649a1e149a58421310daa30d4f0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:40.273331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 22:04:40.273678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce22d3-8ba1-4676-9600-c1228265695c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:40.278262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon May 16 22:04:40 2022] GET /identity/v3/projects/8d531649a1e149a58421310daa30d4f0 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:42.480415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e00eb-b237-4783-9ff4-9041c42b1997 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:42.480962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e00eb-b237-4783-9ff4-9041c42b1997 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:42.480962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e00eb-b237-4783-9ff4-9041c42b1997 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:42.485689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:04:42.491143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:42.491540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:42.491709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:42.511521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:42.513027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:42.520844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 22:04:42.543415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e00eb-b237-4783-9ff4-9041c42b1997 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:42.555894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e00eb-b237-4783-9ff4-9041c42b1997 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:42.560121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:42.560751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:42.561040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:42.561353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:42.569149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:42.570948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ca2e-9505-46c1-a0ea-9a47bc8565ad admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:42.579492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon May 16 22:04:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:04:42.584566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:42.593782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7599627-8d44-4c4c-9a34-1b605ef076f9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:42.598137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:42.598984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:42.599268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:42.599546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:42.600913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:42.602774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb830-6ac7-4609-b45c-a9450264fcab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:42.604312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon May 16 22:04:42 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:44.891787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e634-14c2-4506-83de-7a01f2f16fbb None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:44.892312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e634-14c2-4506-83de-7a01f2f16fbb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:44.892406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e634-14c2-4506-83de-7a01f2f16fbb None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:44.893715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:04:44.899071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:44.899486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:44.899707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:44.924517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd2a4-ca5a-4679-b415-860394c48bca None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:44.924803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd2a4-ca5a-4679-b415-860394c48bca None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:44.925084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd2a4-ca5a-4679-b415-860394c48bca None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:44.926495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:04:44.932621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:44.932903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:44.933181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:44.975365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG passlib.handlers.bcrypt [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79844) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 22:04:44.975793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG passlib.handlers.bcrypt [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79844) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 22:04:45.022845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:45.024449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:45.028925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:45.031052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:45.107825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:04:45.120617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:04:45.130441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.142756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.225308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7f3a-28d5-4338-a8f6-886e7f59a8ba None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.236427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7943195-9cfd-4017-923f-5c1a02dc92c1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.256703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.257517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.257805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.258082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.269285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:04:45.281138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:45.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:04:45.284061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:04:45.285327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.285845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.286407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.286407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.290469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.354756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.356275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.386420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482f58c-f461-446a-8b92-f957f1583766 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.418185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.418850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.419135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.419412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.420184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:45.420493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.421916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.433177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:45.439086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.446344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 22:04:45.452225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.530839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143138b-285a-40cd-b8f4-2703b5de475f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.547909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476884-5144-44ff-8338-52ea0236c54a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.564488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.565383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.565668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.565940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.567140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.568599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.570390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:45.575416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.579920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.580707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.580988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.581289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.675376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cb40-6b48-4977-8202-288d15c2e4d9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.715157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.715952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.716236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.716511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.717728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.719113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.719217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.720554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.720736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:45.726297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:04:45.741690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:45.742657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:45.743450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:04:45.743450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:04:45.743450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:04:45.743450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:04:45.743450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:04:45.749261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:45.820927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20825b19-c851-4563-bc48-cacb7840fcb4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.843160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c890c8-ff07-4146-a8f5-1adce02ed6e6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:45.853525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.854178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.854463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.854740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.855570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.domain.id=default, user.id=b080d4f8faa8436f9ca4b9fb89dd515d) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:45.855882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.857360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da162c-8d76-4cd8-9652-ea053ee32083 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.864302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/role_assignments?user.id=b080d4f8faa8436f9ca4b9fb89dd515d&scope.domain.id=default&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:45.876458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:45.877147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:45.877461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:45.877736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:45.878481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:45.878789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:45.880484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7a427-bb12-40cf-be06-ff87baa29a77 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:45.899748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:48.590522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba3d5-1a83-4bf1-b9eb-66b507fe2363 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:48.591032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba3d5-1a83-4bf1-b9eb-66b507fe2363 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:48.591129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ba3d5-1a83-4bf1-b9eb-66b507fe2363 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:48.592993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:48.598733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:48.599187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:48.599277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:48.621457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:48.622655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:48.642960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130e89-3cf4-4d75-9d66-f3039ab44db9 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:48.643258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130e89-3cf4-4d75-9d66-f3039ab44db9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:48.643529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130e89-3cf4-4d75-9d66-f3039ab44db9 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:48.645244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 13/23] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:48.666977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:48.667584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:48.668068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:48.698342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:48.699920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:48.706551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:48.742697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:48.815271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:48.841320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:48.901613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada3abe-2f75-40b1-9898-63f1c133d804 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:48.958764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:48.959588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:48.959868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:48.960143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:48.979363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:04:48.993057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:48.994142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:48.994920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:04:48.997245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 12/26] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:04:49.002071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc00c-5374-461f-89b9-9f12458a96ea None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.005468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.065062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.066141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.066572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.067073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.085229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.087096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:04:49.115826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:49.116626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:49.117415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:04:49.117415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:04:49.117415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:04:49.117415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:04:49.119679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 15/27] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:04:49.125655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.182460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293d3cb-76f8-4f52-8dbc-0dfa2b993138 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.240046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.241153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.241652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.242099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.243032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:49.243511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.245067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c6596-c4e3-4d91-aadb-c6364df320a5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.253122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb526a-2d4f-4f6e-b6e1-d8e40753d6f0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.258463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 13/28] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:49.259991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc527da-a883-48e6-bad6-061b50a035a3 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.260494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc527da-a883-48e6-bad6-061b50a035a3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.260965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc527da-a883-48e6-bad6-061b50a035a3 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.263027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 14/29] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:49.264385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5c93-bfcb-452e-a314-5070c98dbea4 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.264865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5c93-bfcb-452e-a314-5070c98dbea4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.265370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5c93-bfcb-452e-a314-5070c98dbea4 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.267068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:49.267987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5c93-bfcb-452e-a314-5070c98dbea4 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.290485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.291403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.291831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.292250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.293151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:49.293642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.295852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808c972-e7c2-4625-bd04-484724c09b30 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.314173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 16/31] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:49.315742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80568-5706-48e6-bbdd-44db6ef1d0b4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.316250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80568-5706-48e6-bbdd-44db6ef1d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.316710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80568-5706-48e6-bbdd-44db6ef1d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.333635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-22b80568-5706-48e6-bbdd-44db6ef1d0b4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:49.335062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-22b80568-5706-48e6-bbdd-44db6ef1d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:49.379298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5c93-bfcb-452e-a314-5070c98dbea4 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.405294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 17/32] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:49.406795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.407264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.407759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.414121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.415142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.415493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.415839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.417512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.419042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.421132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 16/33] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:04:49 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:49.422053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.426508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:49.428003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:49.497588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 18/34] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:49.499397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.530944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bc82a-b459-4094-be52-42a7ff6c493b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.569214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.570405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.570405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.570598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.571337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.572878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.601945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dfe80-43e0-4727-9db9-de2ece74770e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.638723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.639838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.640300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.640789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.642189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.643826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.645732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 19/35] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:49.646650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.719092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 17/36] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:04:49 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:04:49.720270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.756101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a5ec5-07b8-4ab4-95cd-22d30c016c79 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.809439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.809439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.809439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.809439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.809744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.809744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd777b8-b324-44c8-b58d-25c88e8d6aec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.870730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f277-8ae3-48ec-909c-af5a620e3033 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:49.947880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:49.948802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.949298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.949723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.950625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:49.952347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:49.969867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 22:04:49 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:04:49.970977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:49.995975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 20/38] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 22:04:49 2022] POST /identity/v3/roles => generated 219 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:04:49.995975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6fbf-590f-45e8-812e-650adb5f4b29 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:49.995975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6fbf-590f-45e8-812e-650adb5f4b29 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:49.995975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6fbf-590f-45e8-812e-650adb5f4b29 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:49.997008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 21/39] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:50.009062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.009638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.010029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.032767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:50.035625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:50.125890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 22/40] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:50.150220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:50.159020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea89522-24ac-4b17-bd4b-54ff5df7d572 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:50.205971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:50.207198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.207709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.208174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] PATH_INFO: `/v3/domains/default/users/b080d4f8faa8436f9ca4b9fb89dd515d/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.212988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b080d4f8faa8436f9ca4b9fb89dd515d, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:50.214830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c902da-6296-48e0-9cb7-9c80405989ce None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:50.241971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 19/41] 10.222.0.13 () {58 vars in 1361 bytes} [Mon May 16 22:04:49 2022] PUT /identity/v3/domains/default/users/b080d4f8faa8436f9ca4b9fb89dd515d/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:04:50.288098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4711df-549b-48be-b4db-7f16b0c32c1a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:50.324886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e653-f551-4f9b-812b-cd65a2d78a59 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.324886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e653-f551-4f9b-812b-cd65a2d78a59 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.325174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944e653-f551-4f9b-812b-cd65a2d78a59 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.327032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 20/42] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:04:50.333784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:50.334617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.334902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.335236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.336496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:50.338550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:50.339647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.339945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.340229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.340338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 23/43] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:50.346005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:50.370323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:50.371932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:50.460766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 21/44] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:50.469268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459ab1-6510-4f05-ac1a-5768c2d2343d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:50.483707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:50.504169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:50.504838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.505407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.505685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.506394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:50.507861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22738b94-1e9d-47cd-ae95-8a408a900716 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:50.533926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 24/45] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:04:50 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:04:50.584435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76989ad-a751-46f5-9411-b9b4475793ea None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:50.621014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:50.621835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:50.622194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:50.622549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:50.623446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:50.625006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80b923-e614-427a-8ab2-df052ded49c7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:50.642948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 22/46] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 22:04:50 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:04:52.506184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779383f-6aa7-467c-97c5-016133e4762a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.506722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779383f-6aa7-467c-97c5-016133e4762a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.506722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779383f-6aa7-467c-97c5-016133e4762a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.508107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 25/47] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:52.513292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e6c1-b2de-471f-8a85-b4e4edb2a02f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.513697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e6c1-b2de-471f-8a85-b4e4edb2a02f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.514361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533e6c1-b2de-471f-8a85-b4e4edb2a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.531161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4533e6c1-b2de-471f-8a85-b4e4edb2a02f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:52.532356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4533e6c1-b2de-471f-8a85-b4e4edb2a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:52.597545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:52.620766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779383f-6aa7-467c-97c5-016133e4762a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:52.717669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779383f-6aa7-467c-97c5-016133e4762a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:52.748406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:52.749190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.749502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.749776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.759593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:04:52.764301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b277e-e099-4ce0-ae02-14110151b6ec None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.764602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b277e-e099-4ce0-ae02-14110151b6ec None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.764888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b277e-e099-4ce0-ae02-14110151b6ec None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.766288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 24/49] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:04:52.767531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:52.768605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:04:52.769386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 26/50] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:04:52.771143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.771435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.771715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.774276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:52.789456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:52.790653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:52.853370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 25/51] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:52.870607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543ac37-19c9-48fb-a001-b347804bf239 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:52.876135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:52.906379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:52.907009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:52.907304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:52.907661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:52.908419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:52.908732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:52.910166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:52.918291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 27/52] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:52.923688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:52.970238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ced42b-c216-4d0c-83b9-b4c4fa605efc None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:53.001771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:53.002556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:53.002845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:53.003127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:53.004301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:53.006028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:53.007628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:53.013084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:53.016304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528ccb5-971c-4dfd-9f64-1abdc3e579ab None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:53.047042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:53.047900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:53.048185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:53.048469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:53.049691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:53.051144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:53.052737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 28/54] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:04:52 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:53.058080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:53.104626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5928-6a1d-4c11-a91b-4b7fb08d7908 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:53.137272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:53.137929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:53.138213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:53.138490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:53.139733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:53.141151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:53.150280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfe980-3d9f-4c64-a94b-79cd854a0f03 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:53.164268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 27/55] 10.222.0.13 () {60 vars in 1140 bytes} [Mon May 16 22:04:53 2022] POST /identity/v3/projects => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:04:53.183222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:53.184152 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:53.184439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:53.184717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:53.186545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:53.188053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb8e37-8d75-4f95-8fc7-84fb89d01c75 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:53.189790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 29/56] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:04:53.195889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:53.297759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e34d3d-7ca1-490e-b5b4-b976ccbfbd61 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:53.331489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:53.332156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:53.332443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:53.332729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:53.333602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.domain.id=default, user.id=b080d4f8faa8436f9ca4b9fb89dd515d) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:53.333918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:53.335375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f23ec4-ca86-43bd-a470-163ba273a15b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:53.343618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1322 bytes} [Mon May 16 22:04:53 2022] GET /identity/v3/role_assignments?user.id=b080d4f8faa8436f9ca4b9fb89dd515d&scope.domain.id=default&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:55.403727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddb3-8647-4eb9-bc8d-2adc84e7d83d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:55.404237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddb3-8647-4eb9-bc8d-2adc84e7d83d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:55.404324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fddb3-8647-4eb9-bc8d-2adc84e7d83d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:55.405721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 30/58] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:55.410823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:55.411182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:55.411386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:55.427524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:55.428712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:55.490788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 29/59] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:55.515745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fddb3-8647-4eb9-bc8d-2adc84e7d83d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:55.610163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fddb3-8647-4eb9-bc8d-2adc84e7d83d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:55.641762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:55.642538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:55.642821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:55.643097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:55.644306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:55.645788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbe71e-f54f-43e6-abb6-2bd55fc1df30 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:55.647365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 31/60] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:55.652506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:55.753075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00630583-33fe-4416-9ff5-64b607d07b22 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:55.784290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:55.784953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:55.785265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:55.785549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:55.786266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:55.787726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef765c-703a-4263-bfb3-b2062caa7c76 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:55.813371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 30/61] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:04:55 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:04:59.011502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85590678-4d1a-44c7-ac68-79a292cb8578 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.012553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85590678-4d1a-44c7-ac68-79a292cb8578 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.013069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85590678-4d1a-44c7-ac68-79a292cb8578 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.014715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 32/62] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:59.020203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.021098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.021606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.046396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:59.047943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:59.134657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 31/63] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:59.170197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85590678-4d1a-44c7-ac68-79a292cb8578 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:59.304137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85590678-4d1a-44c7-ac68-79a292cb8578 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:59.349877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:59.351031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.351536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.352010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.369964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2ab08acd-7774-4f47-b923-139397267822 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:04:59.378757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:59.379641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:04:59.380636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:04:59.383599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 33/64] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:04:59.392148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:59.514787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c6d35-b52d-4a87-b927-0d6d0e29a48d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:59.554940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a814b4c-2070-4607-96b2-e94094d3c5d8 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.555275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a814b4c-2070-4607-96b2-e94094d3c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.555509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a814b4c-2070-4607-96b2-e94094d3c5d8 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.556985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 34/65] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:59.557918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:59.558628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.558913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.559198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.559999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:04:59.560311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:59.562403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:59.571388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393523a-be9f-4885-9e31-1256afdb8b6b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.571728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393523a-be9f-4885-9e31-1256afdb8b6b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.571955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393523a-be9f-4885-9e31-1256afdb8b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.582200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 32/66] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:59.587828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:59.602251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1393523a-be9f-4885-9e31-1256afdb8b6b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:59.603467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1393523a-be9f-4885-9e31-1256afdb8b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:59.674404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 35/67] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:04:59.681588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5817bb-7905-4e54-8590-e293ba9f672f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.682030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5817bb-7905-4e54-8590-e293ba9f672f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.682577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5817bb-7905-4e54-8590-e293ba9f672f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.684259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 36/68] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:59.694240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5322b9-f769-4e1f-b794-da5d197ca317 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:59.698942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf9c1-3987-4baa-a5c8-5c196f767b01 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.699388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf9c1-3987-4baa-a5c8-5c196f767b01 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.699826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf9c1-3987-4baa-a5c8-5c196f767b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.726487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-abcdf9c1-3987-4baa-a5c8-5c196f767b01 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:59.727946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-abcdf9c1-3987-4baa-a5c8-5c196f767b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:59.729680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:59.730567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.730857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.731136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.733003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:04:59.734593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:04:59.736304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 33/69] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:04:59.737233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:59.796436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 37/70] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:04:59.800812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7687-2360-49fd-a20e-4008e53ab021 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.801297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7687-2360-49fd-a20e-4008e53ab021 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.801726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7687-2360-49fd-a20e-4008e53ab021 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.804015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 38/71] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:59.804948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7687-2360-49fd-a20e-4008e53ab021 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:04:59.838856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2c25-948e-4e4f-b443-9e5ad00543de None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:59.870976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:59.871963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.872242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.872517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.882771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9277a3d3-371d-4512-baf0-8418e442949e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:04:59.890953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:04:59.891953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:04:59.892740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:04:59.896592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 34/72] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:04:59.898458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54557-58ea-45e4-b434-56705d09f0eb None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.898752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54557-58ea-45e4-b434-56705d09f0eb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.899031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a54557-58ea-45e4-b434-56705d09f0eb None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.900319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 35/73] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:04:59.901390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.901846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.902136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.906319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7687-2360-49fd-a20e-4008e53ab021 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:04:59.918026 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:04:59.919225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:04:59.938191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:04:59.938834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:04:59.939116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:04:59.939390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:04:59.980923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 36/74] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:04:59.981777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.014828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.016309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.073750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59ba60-f2d6-48d8-bcfb-14c6edcbccb7 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.105560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.106528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.106630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 39/75] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:00.106702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.106879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.107791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.108615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.110091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec228acb-96e7-4113-8a7a-ead04b1e2300 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.111689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 37/76] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:04:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.112828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.113183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.113400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.129311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:00.130759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:00.192433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:00.193183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.198804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555837e-53be-4741-8857-40cb5fd7c6f7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.230417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.231076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.231363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.231637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.232904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:00.233223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.234628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.242192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.244028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.285914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98944703-2b59-4450-8d89-e82bc76662fb None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.316828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.317662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.317943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.318225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.329176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:00.336977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:00.337842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 39/79] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:00.344234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.351788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232d6d-6114-454b-9437-c3ea47f1f15f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.384005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.384859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.385141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.385439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.386638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.388093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.390371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.391137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.435853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27e4-9a33-439e-a74b-565b3d4ab458 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.468036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.468639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.468919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.469195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.469916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.471347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.484945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5ad58-93ce-4698-827c-5b62432e51a7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.490864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 40/81] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:00 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:00.494138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.520058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.520900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.521190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.521506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.533336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:00.541587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:00.542490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:00.543228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 42/82] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:00.546447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.598354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b3821-29f3-49cb-b572-76201fc82ff1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.632497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.633592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.633976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.634425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.650543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34153-2892-4bb2-95e2-30e64d5fee63 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.653262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.655294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.661983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.661983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.687100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.688014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.688863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.688863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.693605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:00.694060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.695584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.707273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 43/84] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.708503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.767321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b6759-ae5e-4bb7-8426-49485ac78482 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.802582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.803175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.803529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.803871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.804776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=b080d4f8faa8436f9ca4b9fb89dd515d) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:00.805158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.806752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.812193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ca23b-2227-4e78-92c7-906cdcc0bcba None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.812764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/role_assignments?user.id=b080d4f8faa8436f9ca4b9fb89dd515d&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.813653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.849769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.850460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.850747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.851025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.851792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:00.852100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:00.853550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:00.863321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 44/86] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:00.864053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:00.923585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdac32e-9374-46af-95fe-a181f7b9f5e4 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:00.959469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:00.960230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:00.960582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:00.960932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:00.973392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8046cd-905a-44f9-8876-b137230f33c9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.023133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.023978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.024238 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.024516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.030656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.032165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.033937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 45/87] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.034727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.036172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.037717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.139895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 43/88] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:01.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.181328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd9d8-5086-4533-a43a-2d3662e81d8b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.218149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.219034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.219319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.219597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.220803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.222320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.224150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 46/89] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.224729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.237534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eef7d-53fe-45a8-b748-b3fa1a9a15ed None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.272173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.272832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.273115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.273469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.331128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff593d-2ee8-4742-908d-49d1e7b09abc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.342855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.344322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.367540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.368415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.368703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.368969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.370214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.371690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.374251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 47/90] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.375138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.442514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 44/91] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:01.443202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.485762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55e84-c98b-47b7-8b27-3bd94174c8a6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.529518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.530109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.530396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.530674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.561478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999be892-0116-43b8-bb77-caf14e37d59a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.600429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.601959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.616737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.617425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.617710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.617982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.618819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:01.619130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.620575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.633824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=c64fac755de048df8f44054c01499e8f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.634680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.706823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:01.714216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.761406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612c9a4-440b-4acd-b6c0-80a3614065de None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.795907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.796700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.796983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.797282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] PATH_INFO: `/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.798510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] RBAC: Authorizing `identity:get_project(project_id=ea3a5b76da034708bddf4bdfbdeafb25)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.800281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.802056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 46/94] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.815880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:01.887553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa7493-56d2-4fe6-a0b6-58279ed9a4b5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.930527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1437a-a929-4d2a-b227-dbbeebeb637c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:01.968351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.969246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.969537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.969699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:01.969880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.970834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:01.971328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:01.971784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:01.973225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=ea3a5b76da034708bddf4bdfbdeafb25, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:01.973613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.973969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:01.975076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786deef-3851-4c91-907c-f1c84e992964 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.975443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:01.977423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 49/95] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:01.985229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 47/96] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=ea3a5b76da034708bddf4bdfbdeafb25&role.id=c64fac755de048df8f44054c01499e8f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:01.985446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:02.126343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc31e4-1515-40c8-816c-a1d6d9f507ec None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:02.163233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:02.163900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:02.164188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:02.164470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:02.165334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:02.165655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:02.167103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e249b5a-1d40-45e0-a13d-a41086dc4f17 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:02.173288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 50/97] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:01 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:03.578152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bbe9-4b01-4230-aeae-1968c9b15826 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:03.578831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bbe9-4b01-4230-aeae-1968c9b15826 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:03.578831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170bbe9-4b01-4230-aeae-1968c9b15826 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:03.580068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 48/98] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:03.585488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:03.586291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:03.586786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:03.604609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:03.606191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:03.679066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:03.703334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170bbe9-4b01-4230-aeae-1968c9b15826 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:03.829864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170bbe9-4b01-4230-aeae-1968c9b15826 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:03.875005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:03.875821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:03.876107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:03.876382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:03.887102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:03.894772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:03.895594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:03.896738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 49/100] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:03.901747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.004985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f3b66-cb08-4f16-8db4-0a7ca4435472 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.042831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.043514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.043800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.044083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.045452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:04.045764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.047169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f3e8-04d1-440b-a7fa-cf4f7d164f17 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.059716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 52/101] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.065353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.089244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530700-9cff-473e-acf1-679d80143db7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.089601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530700-9cff-473e-acf1-679d80143db7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.089752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530700-9cff-473e-acf1-679d80143db7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.093002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 53/102] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:04.100969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc27-44d5-4443-b43d-b137aafdf452 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.101303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc27-44d5-4443-b43d-b137aafdf452 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.101591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8bcc27-44d5-4443-b43d-b137aafdf452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.128308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ae8bcc27-44d5-4443-b43d-b137aafdf452 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:04.129534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ae8bcc27-44d5-4443-b43d-b137aafdf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:04.197356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:04.198693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c2f1-a2ff-4efe-b5a5-c5aecf8dbf6f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.198987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c2f1-a2ff-4efe-b5a5-c5aecf8dbf6f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.199278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c2f1-a2ff-4efe-b5a5-c5aecf8dbf6f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.200005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548e535-28f9-4690-a4f6-b8d47a530fa7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.200545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 55/104] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:04.210531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.210827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.211116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.238260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:04.239054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.239458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:04.240076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.240428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.240774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] PATH_INFO: `/v3/users/6ecf9b6b8d0f4918919cfdc409e50587` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.254374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] RBAC: Authorizing `identity:get_user(user_id=6ecf9b6b8d0f4918919cfdc409e50587)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.256177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.258006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 50/105] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/users/6ecf9b6b8d0f4918919cfdc409e50587 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.258836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.309194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 56/106] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:04.310079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.379208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4004b-7614-4739-a2da-c562dc175ecc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.411420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff6c40-99b9-4f8f-9a06-201b0f4191d4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.414032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.414892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.415251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.415600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.426750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:04.434266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:04.436041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:04.437809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 51/107] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:04.439260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.451734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.452401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.452688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.452968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.521243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.522743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.545018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076b38-0858-4df2-a86a-428b029d0ccc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.578116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.578912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.579514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.579514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.580624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.582092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.583699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 52/108] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.584463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.621235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:04.622123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.691063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea87e66-4bff-4eb2-91cf-d9234ec214ec None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.722387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b995f-7cd1-44b7-bca4-62591d0c3967 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.724724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.725429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.725715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.725991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.726731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:04.727036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.728662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.737177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 53/110] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.738049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.762055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.762726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.763016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.763295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.764784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.766296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.802170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 58/111] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:05:04 2022] POST /identity/v3/projects => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:04.802170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.849230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e25e13-f79c-4fc0-b424-aebc3023b8a3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.883020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.883919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.884205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.884480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.885815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.887293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.889709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 54/112] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.895560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:04.915328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4fcd2-1302-4fda-b16a-fa283e33ec8c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:04.968938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:04.969827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:04.970114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:04.970394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:04.974372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:04.975900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:04.978097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 59/113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:04.994637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.051568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd3715-4ff3-43a4-bf92-6fe2ffed7a29 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.129061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.129763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.130054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.130603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.131449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=6ecf9b6b8d0f4918919cfdc409e50587) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:05.131761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:05.133238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:05.139953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 55/114] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/role_assignments?user.id=6ecf9b6b8d0f4918919cfdc409e50587&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=b798abe95151444282972e4493b211fe => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:05.156088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd37272-d21b-4d69-9a07-3a17033de6e1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.224234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.225575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.226105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.226599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.234250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:05.236263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f9d10-1b16-4673-af45-c4c3a2affc9a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:05.238579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 60/115] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:04 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:05.244668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.391518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f376fc0-de13-4bcc-b447-1a9d46456192 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.426367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.427268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.427554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.427831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/b080d4f8faa8436f9ca4b9fb89dd515d/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.429880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, user_id=b080d4f8faa8436f9ca4b9fb89dd515d, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:05.431353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57f61-562f-40e2-94c9-4d7c2e555e2f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:05.445751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a43e0-d097-4f44-a91a-15933060dbb3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.446497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a43e0-d097-4f44-a91a-15933060dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.447084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a43e0-d097-4f44-a91a-15933060dbb3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.448377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:05 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/b080d4f8faa8436f9ca4b9fb89dd515d/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:05.449606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 61/117] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:05.449728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01405-4b0a-4da4-ba25-42761b23875f None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.449988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01405-4b0a-4da4-ba25-42761b23875f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.450275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01405-4b0a-4da4-ba25-42761b23875f None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.452165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 57/118] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:05.456722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.457034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.457348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.457862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.458163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.458469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.476454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:05.477627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:05.501723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:05.502944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:05.553334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 58/119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:05.576386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.603891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 62/120] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:05.659659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.678809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3c9e-afb2-42bc-8c02-dcdd5ebb70c6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.715420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.716543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.716969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.717442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.728852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:05.736934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:05.738048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:05.738978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:05.745282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 59/121] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:05.747099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.773541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda7ae8-8e20-4f99-80e9-317d283dbc6c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.817083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.817936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.818223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.818498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.845163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-91036f7a-f12e-4723-9f9a-3abbb263a5e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:05.853631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:05.854453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:05.855640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 63/122] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:05.856503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd7ad-37b4-475b-bf39-2468f7620f5c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.856503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd7ad-37b4-475b-bf39-2468f7620f5c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.856771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbd7ad-37b4-475b-bf39-2468f7620f5c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.858005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 64/123] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:05.860449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c12e8-9724-4211-99cc-c310a61dca5f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:05.866344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd7ad-37b4-475b-bf39-2468f7620f5c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:05.900425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:05.901118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.901604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.901887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.902645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:05.902959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:05.904403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665c813-8281-4a84-a38d-f316d745095d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:05.915686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 60/124] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:05.918919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:05.918919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:05.918919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:05.936304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:05.937592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:06.000454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbd7ad-37b4-475b-bf39-2468f7620f5c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.009449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 61/125] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:06.010211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.037492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.038920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.039594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.040058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.041161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:06.041702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.043270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.053341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 65/126] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.054776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.160130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213fa53-dbac-4e3c-a6a7-815dd79803fe None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.174617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270bc6e-bfc5-4659-880f-1c114290fdb5 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.195582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.196637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.197077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.205225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.218798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.219680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.219968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.220249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.221495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.221938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:06.222948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.224584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 62/127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.233365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:06.239119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:06.240134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:06.240901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:06.242942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 66/128] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:06.243887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.324588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3cbb-37ea-4275-b43a-49915b31f81f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.361820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.362900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.363239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.363520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.364811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.366298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.367917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 63/129] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.368684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.436323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827aae7-03f6-4eb4-ac98-d985ea2f6ce9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.476951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.478102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.478544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.478986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.480326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.481980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.484372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 67/130] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.485306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.536131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645ee2-4751-407f-9aa1-fdfeba99f3d7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.588995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b1c5-936c-4743-87e7-8a6ad7a46c00 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.598280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.598956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.599242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.599520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.600271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:06.600584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.602049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.620368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 64/131] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.621362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.626275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.627418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.627913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.628404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.629877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.631808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.634042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 68/132] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.635087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.735902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ad133-287b-4702-8ec4-3eb5e4beeb83 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.769434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057b4a4-3e2f-4a20-8a52-1fbecbae5364 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.771345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.772465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.772967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.773484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.774936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.776627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.778545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 69/133] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:06.780090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.807918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.808818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.809103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.809408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/1e7bb7e658ec4e09934470583e782ca3/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.811421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, user_id=1e7bb7e658ec4e09934470583e782ca3, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:06.812886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:06.830460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 65/134] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:06 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/1e7bb7e658ec4e09934470583e782ca3/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:06.831521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:06.956875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e05649-60f4-4b9f-8e1b-e08820c77727 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:06.996463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:06.997381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:06.997711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:06.997994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] PATH_INFO: `/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:06.999369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] RBAC: Authorizing `identity:get_project(project_id=ea3a5b76da034708bddf4bdfbdeafb25)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:07.000702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a3b1b-4775-4652-99f8-ec0e3f7e884a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:07.000819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:07.003126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 66/135] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:06 2022] GET /identity/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:07.010047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:07.095317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:07.096230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:07.096516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:07.096793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/1e7bb7e658ec4e09934470583e782ca3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:07.106570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, user_id=1e7bb7e658ec4e09934470583e782ca3, role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:07.108258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6fdfa-4c38-4a10-b5e1-e381a96fcac8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:07.121945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7db4b-39ba-4ca8-baab-f457647bcc26 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:07.134249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 70/136] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:06 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/1e7bb7e658ec4e09934470583e782ca3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:07.161574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:07.162561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:07.162831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:07.163106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] PATH_INFO: `/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25/users/1e7bb7e658ec4e09934470583e782ca3/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:07.165605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] RBAC: Authorizing `identity:create_grant(project_id=ea3a5b76da034708bddf4bdfbdeafb25, user_id=1e7bb7e658ec4e09934470583e782ca3, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:07.167153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7ad20-4f20-48ef-b85d-1740d8ff90da None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:07.183438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 67/137] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:07 2022] PUT /identity/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25/users/1e7bb7e658ec4e09934470583e782ca3/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:05:08.230416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144648f-b71f-454a-ae65-0674925375bb None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.231260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144648f-b71f-454a-ae65-0674925375bb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.231688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144648f-b71f-454a-ae65-0674925375bb None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.233782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 71/138] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:08.239516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.240388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.240882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.266252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:08.268125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:08.301235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09e1a-c777-4179-80b0-72bfa032311c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.301877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09e1a-c777-4179-80b0-72bfa032311c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.302365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09e1a-c777-4179-80b0-72bfa032311c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.304264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 72/139] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:08.309110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.309694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.310744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.330742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:08.333075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:08.371556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 68/140] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:08.418308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:08.439747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 73/141] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:08.532774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:08.566140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656364d-3100-4353-afa1-509c535ecb84 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:08.637691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:08.638929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.639456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.639929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.667819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:08.676499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:08.677359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:08.678135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:08.693515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 69/142] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:08.694550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:08.706554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ac114-ddfe-49d4-a453-2af5a9209040 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:08.765048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:08.766223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.766799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.767281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.773908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:08.775614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:08.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 74/143] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:08.784050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:08.805272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9939b-b2ad-45ee-8980-b0c0b435c6cd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:08.849379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:08.850060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.850343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.850620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.851370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:08.851677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:08.853077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:08.870174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 70/144] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:08.875905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:08.896413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78987191-a98f-4f75-98f4-50c6b449cd90 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:08.935896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:08.936585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:08.936867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:08.937143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:08.937906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:08.939375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4fdd3-40ba-4e1a-9d83-345f795cf482 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:08.974632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 75/145] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:08 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:09.064151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18aa1-b2e0-4640-a665-441865601325 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.064458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18aa1-b2e0-4640-a665-441865601325 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.064638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18aa1-b2e0-4640-a665-441865601325 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.066378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 76/146] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:09.066700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a590153-1753-4edb-a085-c9fc5eb30694 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.071615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.071926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.072187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.102319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:09.103547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:09.125030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.126433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.126922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.127452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] PATH_INFO: `/v3/users/6ecf9b6b8d0f4918919cfdc409e50587` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.129895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] RBAC: Authorizing `identity:get_user(user_id=6ecf9b6b8d0f4918919cfdc409e50587)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:09.133129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:09.135380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 71/147] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:08 2022] GET /identity/v3/users/6ecf9b6b8d0f4918919cfdc409e50587 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:09.141565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:09.251526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 77/148] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:09.277472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:09.356084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f890a49-fbde-4d50-87e3-3aa129a430be None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.422670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b8885-d0f2-4be3-b1dc-69ac1db7cb82 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.424599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.425487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.425771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.426047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.427876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:09.430488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:09.436696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 72/149] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:09 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:09.439410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:09.485701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.486549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.486849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.487128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.507976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:09.519663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:09.520476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:09.521224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:09.525161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 78/150] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:09.531388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:09.618072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029f87-5b8f-4c21-b23a-5ed46a974d6c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.692081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.693194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.693500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.693780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/6ecf9b6b8d0f4918919cfdc409e50587/roles/b798abe95151444282972e4493b211fe` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.697447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, user_id=6ecf9b6b8d0f4918919cfdc409e50587, role_id=b798abe95151444282972e4493b211fe)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:09.699615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:09.707012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22f7b7-7b86-466f-b963-950ad19eb9c5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.726963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 73/151] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:09 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/users/6ecf9b6b8d0f4918919cfdc409e50587/roles/b798abe95151444282972e4493b211fe => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:09.753685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.754380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.754673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.754958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.756001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:09.756322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:09.757825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:09.775483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 79/152] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:09.781453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:09.900478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e4220-2755-4999-b91f-129f6cc6602c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:09.937572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:09.938483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:09.938773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:09.939054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] PATH_INFO: `/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:09.943710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] RBAC: Authorizing `identity:get_user(user_id=b080d4f8faa8436f9ca4b9fb89dd515d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:09.946328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:09.947462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 74/153] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:09 2022] GET /identity/v3/users/b080d4f8faa8436f9ca4b9fb89dd515d => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:09.953139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:10.087494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d9b90-d074-4a57-b71f-5ac1ebf9f0f4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:10.128225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:10.128892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.129174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.129552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.206992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:10.208509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dad52d-4b56-4e82-90a3-5d46dc5495b1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:10.317847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 80/154] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:10.323577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:10.454686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c316e-6afe-4f81-98a2-160a72913eee None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:10.486939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf6e-df6d-4708-a9ad-27cb58791652 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.487227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf6e-df6d-4708-a9ad-27cb58791652 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.487688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ddf6e-df6d-4708-a9ad-27cb58791652 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.488805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 81/155] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:10.498519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:10.499408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.499697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.499982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.501253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:10.502696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.502811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:10.503001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.503252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.504520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 75/156] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:10 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:10.510539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:10.530250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:10.531504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:10.671465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 82/157] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:10.691035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664e13-ab38-4ba6-a5b9-4482933f79e5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:10.718317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:10.738888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:10.739478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.739763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.740035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.740932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=b080d4f8faa8436f9ca4b9fb89dd515d) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:10.741262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:10.742736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d5a8-a426-488e-b456-3dd5bf8c570a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:10.749231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 76/158] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:10 2022] GET /identity/v3/role_assignments?user.id=b080d4f8faa8436f9ca4b9fb89dd515d&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:10.816721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179093f-552d-4e18-be6c-d9c8ad71ce80 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.817027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179093f-552d-4e18-be6c-d9c8ad71ce80 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.817644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179093f-552d-4e18-be6c-d9c8ad71ce80 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.819503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 77/159] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:10.826601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd1d7-82fe-446a-8060-54e7a8d87eb1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.826885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd1d7-82fe-446a-8060-54e7a8d87eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.827161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dd1d7-82fe-446a-8060-54e7a8d87eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.851166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-284dd1d7-82fe-446a-8060-54e7a8d87eb1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:10.853012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-284dd1d7-82fe-446a-8060-54e7a8d87eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:10.939240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647fd1-96d0-47f1-95aa-9069ea3dd260 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:10.979764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 78/160] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:10.981397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12e5d-b59a-4415-8911-4770519ed1d8 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.981864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12e5d-b59a-4415-8911-4770519ed1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.982328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c12e5d-b59a-4415-8911-4770519ed1d8 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:10.983817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 79/161] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:10.990447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:10.990924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:10.991342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.019876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:11.021318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:11.029231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.029231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.029231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.029231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.054283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:11.062593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:11.063559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:11.064418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 83/162] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:11.065105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.131821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 80/163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:11.132944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.244715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b57ca-60ce-4343-89fa-5dc20bc7a4df None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.283933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dca19-5dc8-461d-82c9-c7296da403f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.320922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.321610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.321909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.322296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.322837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.323287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:11.323373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:11.324289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.324716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:11.324848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.325265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.336182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:11.344573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 81/164] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:11.345308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:11.346367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:11.347180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:11.347765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.353586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 84/165] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:11.354671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.479701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb3a17-a1e0-4f27-9658-2b4f168841ad None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.516913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.518095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.518519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.518942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.520317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:11.521985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:11.523774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 85/166] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:11.524691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.584882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7214bee-668d-4b8c-bfce-21aeaa59f9f1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.627394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab67eb-e557-4d48-b7e2-09738b556bac None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.662600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.663526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.663953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.664369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.665287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:11.665837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:11.667182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.667709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:11.667978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.668259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.668529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.677255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 86/167] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:11.678269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.702177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:11.714017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:11.715025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:11.715880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 82/168] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:11.717060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:11.784090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5e638-afce-455f-ab0e-f8db421fd645 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.821979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:11.822868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:11.823323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:11.823738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:11.942906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f41a3-55ed-43f0-84a8-bf5a91c25981 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:11.961459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:11.965099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.007375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.009237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.011030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.011457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.013980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.016438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.021087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 83/169] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:12.023371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.161893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789422f2-a742-48cf-b997-c555cd7abea6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.199924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.201139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.201603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.202382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.203725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:12.204202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.206009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.209110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 87/170] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:12.210046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.216192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:12.218220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.328819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08b05-e62b-4e14-a1bf-0b58403180b8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.367806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.369226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.369721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.370200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.372007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.373767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.376459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 85/172] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:12.377485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.439306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6127a7-2046-4747-973f-039fa2b6054f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.486480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad8f3-4f7e-40fb-bb3b-3a6033b6a49c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.507926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.508593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.508884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.509215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.521986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.523196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.523703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.524192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] PATH_INFO: `/v3/users/1e7bb7e658ec4e09934470583e782ca3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.525605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7bb7e658ec4e09934470583e782ca3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.527246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.529640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 86/173] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/users/1e7bb7e658ec4e09934470583e782ca3 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:12.530619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.624655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.626177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.659931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6772-b13c-4aa2-8c0c-bd8143d91d82 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.705050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.712169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.712728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.713235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.714325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:12.714846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.717125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.723460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 87/174] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=c64fac755de048df8f44054c01499e8f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:12.724478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.734270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 88/175] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:12.739691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:12.887804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c3b96-f66c-4d1d-a67f-6b6e11c4e8c6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.928363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de7e2-f678-4c26-9b39-60005d6554e3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:12.943999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:12.944877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:12.945157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:12.945455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:12.950055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:12.952115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:12.953950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 89/176] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:12.960029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:13.014336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:13.015006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.015288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.015561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.088668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511b9f-2991-449e-8dc5-cf396dddd3e1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:13.131334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:13.132010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.132296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.132639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.133524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:13.133839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:13.135345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:13.144809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 90/177] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:13.163475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:13.164969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:13.289622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 88/178] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:13.296094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:13.427813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1597-6d05-4d27-b103-9bee3d65b185 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:13.472837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:13.473738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.474023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.474301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] PATH_INFO: `/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.475529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] RBAC: Authorizing `identity:get_project(project_id=ea3a5b76da034708bddf4bdfbdeafb25)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:13.476996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d126-9b99-415e-9fad-c6385f8e987a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:13.478752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 91/179] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:13 2022] GET /identity/v3/projects/ea3a5b76da034708bddf4bdfbdeafb25 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:13.485051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:13.513739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147084-1abc-4b9a-8aeb-8684e8dc974a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.514061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147084-1abc-4b9a-8aeb-8684e8dc974a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.514296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84147084-1abc-4b9a-8aeb-8684e8dc974a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.515928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 92/180] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:13.521082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.521395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.521678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.551800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:13.552946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:13.592735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc58734-cd8a-4892-b6f3-80cc57ce4f97 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:13.629689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:13.630646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.630929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.631208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.632098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=ea3a5b76da034708bddf4bdfbdeafb25, user.id=1e7bb7e658ec4e09934470583e782ca3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:13.632412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:13.633934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:13.640457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 89/181] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:13 2022] GET /identity/v3/role_assignments?user.id=1e7bb7e658ec4e09934470583e782ca3&scope.project.id=ea3a5b76da034708bddf4bdfbdeafb25&role.id=c64fac755de048df8f44054c01499e8f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:13.653754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 16 22:05:13.679467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:13.806307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99c392-2669-47d6-805e-85fa4e258a68 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:13.854493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:13.855368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.855653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.855920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.868572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-893d2f17-84c1-4d95-a5b9-39a6d7b596fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:13.876691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:13.878997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:13.881348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:13.889234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:13.932250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb9e0-edab-4c4e-a0d1-295423ab4302 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.932607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb9e0-edab-4c4e-a0d1-295423ab4302 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.932795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdb9e0-edab-4c4e-a0d1-295423ab4302 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.934638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 91/184] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:13.940603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764081e-1696-438c-b721-48028d6e9dfe None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:13.941122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764081e-1696-438c-b721-48028d6e9dfe None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:13.941327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764081e-1696-438c-b721-48028d6e9dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:13.963493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4764081e-1696-438c-b721-48028d6e9dfe None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:13.964717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4764081e-1696-438c-b721-48028d6e9dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:14.027936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab447c16-976e-4653-9b48-99d7dd5d2799 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.063007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 92/185] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:14.073868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.074546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.074827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.075099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.075886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:14.076187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.077599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.079639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032f2f-243b-4d6f-bf6b-0882badd1d30 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.080150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032f2f-243b-4d6f-bf6b-0882badd1d30 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.080652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4032f2f-243b-4d6f-bf6b-0882badd1d30 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.082269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 93/186] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:14.087036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 94/187] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.087853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.088229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.088506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.093086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.106511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:14.108616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:14.179639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 94/188] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:14.180391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.191973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307231c-4f48-4617-91aa-9abc6a6cbdfc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.225362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.226233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.226511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.226782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] PATH_INFO: `/v3/users/6ecf9b6b8d0f4918919cfdc409e50587` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.227975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] RBAC: Authorizing `identity:get_user(user_id=6ecf9b6b8d0f4918919cfdc409e50587)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.229460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc18d-5cd4-4341-ab83-53ce4bb24baf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.231226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 95/189] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/users/6ecf9b6b8d0f4918919cfdc409e50587 => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.232756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae5f8-0cc0-49ef-b90f-ca4d2780a757 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.233043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae5f8-0cc0-49ef-b90f-ca4d2780a757 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.233344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae5f8-0cc0-49ef-b90f-ca4d2780a757 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.234570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 96/190] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:14.239481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ae5f8-0cc0-49ef-b90f-ca4d2780a757 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.276363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780b930-1901-4d35-9807-98cc5977e171 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.308080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.308877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.309158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.309480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.319656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:14.327682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:14.328590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:14.329428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 95/191] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:14.331077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.333892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ae5f8-0cc0-49ef-b90f-ca4d2780a757 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.365793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.366855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.367116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.367389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.368557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.370059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad317210-2256-4f5e-9bde-456c7bbae638 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.371684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 97/192] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.377628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.377628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.377628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.390110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:14.391392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:14.432288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44d057-293d-43df-b326-170ce976a390 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.453936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 98/193] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:14.454767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.472423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.473070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.473382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.473657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.537596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.539039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.547520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ac59e-0087-443a-8ee9-7d0d10942967 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.579343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.579940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.580221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.580496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.581269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:14.581576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.582955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.590424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 99/194] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.590424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.635888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 96/195] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:14.640780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.684267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37bc1-d8e9-4f3b-9f8a-b9c8187d58f6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.715293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.716047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.716846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.717121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.717852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.719293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.731595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818d253-1bd0-4d49-b91f-9e99965204e0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.737954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 100/196] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:14 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:14.738771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.766130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.766943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.767221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.767488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.778573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:14.786961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:14.787864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 97/197] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:14.795156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.846346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb04af-624f-4f4b-a473-a81d7d463db3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.881502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.882395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.882692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.882964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.897961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.899860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.902322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 101/198] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.903040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:14.910470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8350e-2808-41a0-8c01-cd06834c850e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:14.946951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:14.947831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:14.948099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:14.948370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:14.949582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:14.951561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:14.954288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 98/199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:14.955096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.015905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e9fe-dfb6-4747-b81d-66d073c6e4e3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.063609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.064282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.064559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.064830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.065733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:15.066038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.069645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.076147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c0abf-9389-4a1f-b146-50ee6657019e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.079182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 102/200] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:15.080013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.115653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.116171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.116450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.116723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.185476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.187020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.198551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338bf5-4c5f-4573-b197-1aeff09430d3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.239587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.240253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.240538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.240817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.241693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, scope.project.id=59159f86fa0b4eea94aabb3abf755add, user.id=6ecf9b6b8d0f4918919cfdc409e50587) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:15.242007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.243461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.249637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 103/201] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/role_assignments?user.id=6ecf9b6b8d0f4918919cfdc409e50587&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=b798abe95151444282972e4493b211fe => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:15.250459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.310088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 99/202] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:15.316578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.419198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8849-259e-4226-bf68-17e08caa93e8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.464727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.466051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.466583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.467051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.468499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.470213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.472379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 104/203] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:15.477772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.496599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02282965-3790-434e-8c5d-50a1f07f1c75 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.540527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.542622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.542622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.542785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.544857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.546020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.547754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 100/204] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:15.555482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.593487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc493-db8f-4557-b695-802ea3ae8243 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.628911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.629897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.630686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.631131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.684221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fd46-96b3-432e-bd7f-a661cb66a5f8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.709173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.713274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.730966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.731694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.732258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.732258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.733327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=185cb37de3da4b7e8292d87ea47fbcd7) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:15.733643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.735434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.742454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 101/205] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/role_assignments?user.id=185cb37de3da4b7e8292d87ea47fbcd7&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:15.834302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 105/206] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:15.849231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:15.946405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071916f3-aade-4189-b896-5899ac2d57eb None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:15.981660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:15.983054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:15.983337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:15.983612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:15.984796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:15.986298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdf97b-7f03-4639-bdc9-c34c1bc4c58e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:15.988303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 102/207] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:15.993757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:16.095477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6061e-b8cb-4e76-b5a3-12f1822a3ef5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:16.128704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:16.129393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:16.129679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:16.129952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:16.131044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=185cb37de3da4b7e8292d87ea47fbcd7) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:16.131350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:16.132823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec2f12-fdd5-48d4-b299-b8e59c11bf0f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:16.139289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 106/208] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:15 2022] GET /identity/v3/role_assignments?user.id=185cb37de3da4b7e8292d87ea47fbcd7&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:17.209847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ad0c-6b3f-4aff-b0ab-fa934a29c5d2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.210355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ad0c-6b3f-4aff-b0ab-fa934a29c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.210435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ad0c-6b3f-4aff-b0ab-fa934a29c5d2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.211760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 103/209] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:17.217174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.217940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.218354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.236041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:17.237573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:17.284706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327edb-3bf7-423a-a355-4cba2a55fde5 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.284996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327edb-3bf7-423a-a355-4cba2a55fde5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.285309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6327edb-3bf7-423a-a355-4cba2a55fde5 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.286680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 104/210] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:17.291581 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.291869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.292148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.306986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 107/211] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:17.313309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:17.313309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:17.330808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.382307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 105/212] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:17.406263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.449029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab008e-3603-4da7-9ee5-6b8905bacfac None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:17.492155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:17.492876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.493597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.493878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.505511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8b2e-3bfc-46aa-abb3-1e94c60f8023 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:17.507190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:17.517114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:17.518001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:17.518760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 108/213] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:17.524156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.541625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:17.542614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.542996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.543389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.545212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:17.546763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:17.548554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 106/214] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:17.553829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.622994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12849ecd-9add-47f2-a939-f6fd25ca7c62 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:17.656101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:17.656774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.657057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.657434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.658153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adba65-0531-4bb5-8437-4a02d74364b4 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:17.658310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:17.658475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:17.659879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:17.673318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 109/215] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:17.674632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.695423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:17.696210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.696604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.696948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.697831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:17.699397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:17.726989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 107/216] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:17 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:05:17.784024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923c28b-dd71-4c07-8c44-14871aa1c472 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:17.821419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:17.822396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:17.822686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:17.822958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] PATH_INFO: `/v3/users/0347d7ecfe9b4bd1a18897549ba29303` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:17.838968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0347d7ecfe9b4bd1a18897549ba29303)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:17.840431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c575a-43be-45c6-ba0a-cbefb510b9e8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:17.843652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 110/217] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:17 2022] GET /identity/v3/users/0347d7ecfe9b4bd1a18897549ba29303 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:17.850361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:17.967996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef74fa-499f-476b-9f08-b364cfef98c0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.001474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.002132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.002410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.002679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.065182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032c5-b4e7-489c-87b9-559cb3055f1f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.065457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032c5-b4e7-489c-87b9-559cb3055f1f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.065703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032c5-b4e7-489c-87b9-559cb3055f1f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.068272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 111/218] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:18.073471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.073769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.074029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.075008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:18.077149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:18.097690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:18.098881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:18.188871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 112/219] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:18.195083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 108/220] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:18.200720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.212732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.303213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca680c-6021-4340-a0ac-78b56f66429d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.317809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2092c-6898-41ae-b4d4-b31fb4f4fe5a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.337027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.338136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.338556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.339006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.340369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:18.342517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:18.344361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 113/221] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:18.350311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.361666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.362540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.362825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.363099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.382993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:18.399528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:18.400652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:18.401630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 109/222] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:18.407463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.454794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7075865-8115-4f89-b966-84b81f8862d8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.488266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.489155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.489610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.490019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.490992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=0347d7ecfe9b4bd1a18897549ba29303) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:18.491463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:18.493046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d89c3-6216-4260-9e23-da9c34c3b723 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:18.499342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 114/223] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/role_assignments?user.id=0347d7ecfe9b4bd1a18897549ba29303&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=c64fac755de048df8f44054c01499e8f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:18.507118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534169-12f5-4a71-a725-6129a556aca3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.507596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534169-12f5-4a71-a725-6129a556aca3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.508075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c534169-12f5-4a71-a725-6129a556aca3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.509959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 115/224] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:18.516280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.516822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.517304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.531579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698657c-8a32-4d08-9787-75c17a25ec9c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.541501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:18.542944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:18.600616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.601630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.603028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.603685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.605010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:18.606182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:18.609576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:18.626657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 110/225] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:18.638866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.642372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 116/226] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:18.669812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.789777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61c0ba-9a73-4625-8ecf-6d0008be9dc8 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.827181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.827987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.828273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.828552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.840487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:18.849700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:18.850555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:18.851364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 117/227] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:18.859086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:18.874128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a956-8679-4afc-bd5b-ba2f6971e02c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:18.938207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:18.939102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:18.939382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:18.939654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:18.941623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:18.943064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:18.952512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 111/228] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:18.954470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:19.039433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ce38-d3ed-4915-bddb-880d4c7096db None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.092362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c208cc-5dbd-4eb8-be25-0afac3f4bbdd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.126784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.127383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.127671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.127952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.128713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:19.129024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.130702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.143608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.144502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.144790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.145069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.147252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.148713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.151925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 118/229] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:19.152906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 112/230] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:18 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:19.158136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:19.174922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:19.320154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27674926-65e0-495b-92f7-33fd520d2cc2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.342417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8823d80-d0c3-44ce-b97f-c59905ed934e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.382699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.383911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.384387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.384869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/185cb37de3da4b7e8292d87ea47fbcd7/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.389531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, user_id=185cb37de3da4b7e8292d87ea47fbcd7, role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.391208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.413816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.414315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 113/231] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:19 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/185cb37de3da4b7e8292d87ea47fbcd7/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:05:19.415635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.416126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.416594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.418210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.420623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.423324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 119/232] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:19 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:19.428534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:19.538584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad4ba7-c0f3-435a-8c92-8878efc14123 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.573419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.574627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.575151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.576190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.577593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.579213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0f5ad-a916-41a2-92ea-e2fafaf899ad None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.581462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 114/233] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:19 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:19.590424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:19.709330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fb886-fcc8-475d-9703-96da5aaec0b5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:19.751315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:19.752556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:19.753067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:19.753667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/185cb37de3da4b7e8292d87ea47fbcd7/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:19.756138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, user_id=185cb37de3da4b7e8292d87ea47fbcd7, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:19.757846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b5113-1a32-4b77-9b09-3d164cb298ee None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:19.775128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 120/234] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:19 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/185cb37de3da4b7e8292d87ea47fbcd7/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:20.529622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a602d9-5f09-43ec-a491-aa65569cd45c None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:20.530647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a602d9-5f09-43ec-a491-aa65569cd45c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:20.531127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a602d9-5f09-43ec-a491-aa65569cd45c None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:20.532967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 115/235] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:20.537933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c96d-4dd0-4cb8-bc82-687a2bd5d98e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:20.538741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c96d-4dd0-4cb8-bc82-687a2bd5d98e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:20.539290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87c96d-4dd0-4cb8-bc82-687a2bd5d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:20.562940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fe87c96d-4dd0-4cb8-bc82-687a2bd5d98e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:20.564445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fe87c96d-4dd0-4cb8-bc82-687a2bd5d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:20.646788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 121/236] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:20.687683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a602d9-5f09-43ec-a491-aa65569cd45c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:20.716252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a0c-3a3c-4774-9ece-43355b21d59c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:20.716559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a0c-3a3c-4774-9ece-43355b21d59c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:20.718510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4205a0c-3a3c-4774-9ece-43355b21d59c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:20.718510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 122/237] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:20.724787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:20.725080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:20.725462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:20.751199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:20.752428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:20.847532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a602d9-5f09-43ec-a491-aa65569cd45c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:20.883412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 123/238] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:20.921506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:20.931331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:20.932147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:20.932435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:20.932712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:20.962099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:20.969981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:20.970855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:20.971614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:20.982179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 116/239] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:20.987402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.027091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d2205-414a-456a-880e-e314e411fb74 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.072132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.072995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.073310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.073591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.074806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.076815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5839a-dec7-4ca4-9434-120899fa0958 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.079437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 124/240] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:21.080965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5a04-119a-4d2d-84fc-165ae5815303 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.086286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5a04-119a-4d2d-84fc-165ae5815303 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.086617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5a04-119a-4d2d-84fc-165ae5815303 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.088037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 125/241] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:21.088617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5a04-119a-4d2d-84fc-165ae5815303 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.143864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad499-7fc7-41fd-8939-a1239a23cdf0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.185585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.186267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.186551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.186825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.187894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:21.188201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.189904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1389cc-edbc-448e-beb3-701c8219a711 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.207212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 117/242] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:21.208840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.209398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.209844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5a04-119a-4d2d-84fc-165ae5815303 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.210111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.231011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:21.233551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:21.244835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.245535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.245820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.246415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.246807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.248879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.273741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 126/243] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:21 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:21.277268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.365785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 118/244] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:21.387792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.486754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59482bb9-81a9-43c8-b776-dd9ee358a175 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.504462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5a637-a4b0-4598-95f8-959302534d50 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.526382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.527264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.527549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.527832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] PATH_INFO: `/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.542279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c8bf56d4399f41bf87c45f3c11f8bb7d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.543830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.546986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 127/245] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:21.547098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.547905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.548191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.548461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.552167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.561044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:21.572031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:21.572889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:21.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 119/246] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:21.580361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.671540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973e64-5853-4c7b-8542-b968954a10c0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.705010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6479-34df-4f1c-8d50-87131dc28bd3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.708153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.708865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.709156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.709527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.744841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.745801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.746088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.746364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.747111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:21.747986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.749441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.759361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 120/247] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:21.765097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.798289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.799807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.894526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1642bc-bf3d-4bb8-a54f-edc00bd89005 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:21.939299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:21.940163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:21.940445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:21.940718 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] PATH_INFO: `/v3/users/0347d7ecfe9b4bd1a18897549ba29303` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:21.942050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] RBAC: Authorizing `identity:get_user(user_id=0347d7ecfe9b4bd1a18897549ba29303)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:21.943501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:21.945368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 121/248] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/users/0347d7ecfe9b4bd1a18897549ba29303 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:21.951142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:21.952744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 128/249] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 22:05:21.958366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:22.056313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a449-ef4a-4898-a42e-02fbea385d17 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.074110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33ba0-9028-49b9-bcbf-5e25a7c2b114 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.090641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:22.092243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.092421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.092696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.102004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:22.103480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:22.105257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 122/250] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:22.111005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:22.114860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:22.115956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.116461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.116941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.119224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:22.120908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:22.123700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 129/251] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:21 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:22.131079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:22.237185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c9ab-ee7a-4805-ac8f-b850e9eb289a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.276342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:22.277651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.279166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.279797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/0347d7ecfe9b4bd1a18897549ba29303/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.282274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, user_id=0347d7ecfe9b4bd1a18897549ba29303, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:22.284001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a64e55-ff60-47da-adaa-e727510a7373 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:22.300542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 123/252] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:22 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/0347d7ecfe9b4bd1a18897549ba29303/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:05:22.346285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080d17-5957-4991-b4fb-405d0181a5c7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.388099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:22.388768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.389049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.389351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.390192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=c8bf56d4399f41bf87c45f3c11f8bb7d) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:22.390503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:22.391961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b5d2b-9194-46cb-82ef-4dd1c5ff45ca None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:22.402537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 130/253] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:22 2022] GET /identity/v3/role_assignments?user.id=c8bf56d4399f41bf87c45f3c11f8bb7d&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=b798abe95151444282972e4493b211fe => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:22.460168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557a18-2e5e-4a32-a75f-63b0df761eab None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.460830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557a18-2e5e-4a32-a75f-63b0df761eab None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.461353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557a18-2e5e-4a32-a75f-63b0df761eab None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.462989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 124/254] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:22.469266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.469589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.469834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.490567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:22.491722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:22.580270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 131/255] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:22.619977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557a18-2e5e-4a32-a75f-63b0df761eab None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:22.751081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557a18-2e5e-4a32-a75f-63b0df761eab None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.786664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:22.787475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.787757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.788114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.803938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9b03c399-a763-46f4-a29d-6de864425295 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:22.812160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:22.813104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:22.813894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 125/256] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:22.820692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:22.845378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe302-9036-486a-a71a-3f97dcb9e360 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.845676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe302-9036-486a-a71a-3f97dcb9e360 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.845940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe302-9036-486a-a71a-3f97dcb9e360 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.847572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 126/257] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:22.852351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:22.852639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:22.852914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:22.870283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:22.871474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:22.943870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 127/258] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:22.969055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00fa0-bf14-4a23-970e-e327dfddf8c2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:22.982312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.040875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.041814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.042272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.042698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.043597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:23.046723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.048392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.065283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 132/259] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:23.071252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.187561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c458bd5-15d8-4acb-9cd9-6a499ff17337 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.197318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4b507-95e3-47f5-8bf8-cf7905d2d702 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.234237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.235362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.235847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.236263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.238043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.240077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.242423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 133/260] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:23.249801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.269906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.270954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.271380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.271820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.302161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:23.317227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:23.318292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:23.319190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:23.321379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 128/261] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:23.326916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.357168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707aca91-b663-485d-abe0-50fb5f869e2d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.394757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.395663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.396090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.396540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.466794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.468551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.544763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a266eb-8648-4de9-8a8e-6e12dda6024a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.570906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 134/262] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:23.578185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.594434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.595328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.595817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.596282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.597258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:23.597757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.599347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.616786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 129/263] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:23.617926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.708232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fab6b-d451-4295-ba0b-7d6daf513a5c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.760749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.761892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.762369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.762952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.768936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627dd91-70ff-4a58-9529-1d2cafb4bedd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:23.770008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.771492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.773335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 135/264] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:23.779675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.816084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:23.816974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:23.817270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:23.817542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] PATH_INFO: `/v3/users/185cb37de3da4b7e8292d87ea47fbcd7` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:23.818857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] RBAC: Authorizing `identity:get_user(user_id=185cb37de3da4b7e8292d87ea47fbcd7)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:23.820307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:23.822030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 130/265] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/users/185cb37de3da4b7e8292d87ea47fbcd7 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:23.827775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:23.989645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2067eb-eca0-4c7c-9148-e892f21f74df None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:24.026528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:24.027181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.027459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.027727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.040659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7271-730a-4d56-97e2-076884493677 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:24.105807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:24.106385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.107234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.107481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.108315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=185cb37de3da4b7e8292d87ea47fbcd7) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:24.108623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:24.110094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:24.124774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 136/266] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/role_assignments?user.id=185cb37de3da4b7e8292d87ea47fbcd7&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:24.141482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:24.143027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:24.244790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 131/267] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:24.250211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:24.365318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86fdbc-54c1-4b37-8d80-56e3b43da36b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:24.411023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:24.411910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.412188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.412458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.418089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:24.420372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821537f-8702-41ee-a10a-f56525ec236a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:24.422629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 137/268] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:24 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:24.427989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:24.552378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749ad83-74a8-4600-b6bb-374e5bc6456c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:24.602853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:24.603521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.603806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.604084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.604922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=185cb37de3da4b7e8292d87ea47fbcd7) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:24.605251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:24.607242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a0697-2122-42c6-b134-029d65ab42db None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:24.618056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 132/269] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:24 2022] GET /identity/v3/role_assignments?user.id=185cb37de3da4b7e8292d87ea47fbcd7&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:24.841646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9d08-b0a9-4a98-a080-1db11ac28dcf None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.842151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9d08-b0a9-4a98-a080-1db11ac28dcf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.842225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9d08-b0a9-4a98-a080-1db11ac28dcf None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.843993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 138/270] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:24.855098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:24.855635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:24.855635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:24.878503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:24.879645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:24.956837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 133/271] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:24.982695 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9d08-b0a9-4a98-a080-1db11ac28dcf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.102059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9d08-b0a9-4a98-a080-1db11ac28dcf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.140879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.141631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.141916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.142191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.143718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:25.145176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a6bc-da10-46b9-af39-442301df343b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:25.147135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 139/272] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:25.152462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.193074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f2c-d939-4a59-b14d-fdd2b29f831a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.193402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f2c-d939-4a59-b14d-fdd2b29f831a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.193664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f2c-d939-4a59-b14d-fdd2b29f831a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.195027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 140/273] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:25.203400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.203400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.203400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.225936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:25.227567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:25.269750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005fcc8-1905-457a-b28a-a5142ae8c720 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.312987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.314012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.314293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.314562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.315534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:25.317454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:25.325014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 141/274] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:25.346676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 134/275] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:25 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:25.351987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.464232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd059a3-7846-4a0c-9a92-c67928237c51 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.500356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278563-2795-4992-9508-a13286550f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.501165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278563-2795-4992-9508-a13286550f12 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.501474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278563-2795-4992-9508-a13286550f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.501748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278563-2795-4992-9508-a13286550f12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.514052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278563-2795-4992-9508-a13286550f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-eb278563-2795-4992-9508-a13286550f12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:25.521879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:25.522791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:25.523579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:25.527945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 142/276] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:25.530038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.574397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adf39-a932-4913-ae83-96dcbd114d22 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.574699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adf39-a932-4913-ae83-96dcbd114d22 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.574944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463adf39-a932-4913-ae83-96dcbd114d22 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.577131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 143/277] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:25.582134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.582594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.582697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.599952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:25.601159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:25.644060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e875-fa39-495a-9550-72a8cc102462 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.675971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 144/278] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:25.680425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.681146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.681472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.681735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.682476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:25.682786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:25.684152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:25.693282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 135/279] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:25.699008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.699472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.841609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8790e65-e997-4b30-bdb4-cf0d1ffe78dd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.844834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee91515-ecca-49ee-a75d-d3ba36bfcbc6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:25.876142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.877016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.877330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.877621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] PATH_INFO: `/v3/users/7b90e67072524d6bba59d47a7f55a68b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.888648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:25.889648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:25.889933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:25.890213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:25.893093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] RBAC: Authorizing `identity:get_user(user_id=7b90e67072524d6bba59d47a7f55a68b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:25.895034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:25.897564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 136/280] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/users/7b90e67072524d6bba59d47a7f55a68b => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:25.903492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:25.904371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:25.912098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:25.912978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:25.913776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:25.917726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 145/281] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:25.922206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.026153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9d27e-0871-42c1-96cd-a2db620d81ae None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.038974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425efa2-da49-4aca-813f-ad6284f85249 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.060679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.061287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.061571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.061859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.062797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, user.id=7b90e67072524d6bba59d47a7f55a68b, scope.system=all) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:26.063113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.064551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addcb0b-73a6-4871-9a68-03e2b3e3ff28 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.071085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 137/282] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/role_assignments?user.id=7b90e67072524d6bba59d47a7f55a68b&scope.system=all&role.id=c64fac755de048df8f44054c01499e8f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:26.078739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8790-00e4-41d1-a897-f17c13b83f05 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.079072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8790-00e4-41d1-a897-f17c13b83f05 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.079294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8790-00e4-41d1-a897-f17c13b83f05 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.087089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 138/283] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:26.088579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.088868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.089149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.090903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.091606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.091892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.092168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.092949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:26.093295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.094750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.108033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:26.109280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:26.115940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 146/284] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:26.131020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.194600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:26.220105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.352020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd513-9b19-433a-8083-44da25fc0142 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.355845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba530cf-705f-4d98-9617-1588f51e0a17 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.413009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.413855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.414145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.414418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.417579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.418455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.418734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.419038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] PATH_INFO: `/v3/users/0347d7ecfe9b4bd1a18897549ba29303` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.420954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] RBAC: Authorizing `identity:get_user(user_id=0347d7ecfe9b4bd1a18897549ba29303)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.424579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.426289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 147/286] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/users/0347d7ecfe9b4bd1a18897549ba29303 => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:26.432570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.445481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:26.453778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:26.454617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:26.455372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:26.457129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 140/287] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:26.464742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.587687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367c662-bf3a-48f9-a064-d9cfd3556be9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.625339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b931f4-662f-4dbf-a1b2-b26ec1dd1994 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.660405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.661066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.661380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.661660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.673980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.674662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.674944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.675219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.675969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:26.676277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.677702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.689457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 141/288] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:26.695073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.777162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.779251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.851535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3affa6-9b2c-4a31-a88d-01c6c457853c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:26.899555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:26.900358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:26.900775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:26.901755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] PATH_INFO: `/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:26.903637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] RBAC: Authorizing `identity:get_user(user_id=c8bf56d4399f41bf87c45f3c11f8bb7d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:26.905113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:26.915985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 142/289] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:26.916841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:26.968905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 148/290] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 22:05:26.990716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:27.058857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6b23-09b9-4f92-91ff-bd1c549f7146 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:27.100323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:27.101193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.101496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.101768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:27.105960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:27.107964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:27.109746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 143/291] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:27.115234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:27.128566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ad99-4628-4a37-902c-c04988c99b80 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:27.186547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:27.187671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.188123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.188564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:27.189938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:27.192941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:27.196818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 149/292] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:26 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:27.203144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:27.263520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699231e-fe93-451c-8ebe-b3f86ed941bc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:27.319996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:27.321223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.321743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.322215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/c8bf56d4399f41bf87c45f3c11f8bb7d/roles/b798abe95151444282972e4493b211fe` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:27.324361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, user_id=c8bf56d4399f41bf87c45f3c11f8bb7d, role_id=b798abe95151444282972e4493b211fe)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:27.326669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f412-e8b8-4607-a466-88acb8dafe65 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:27.348940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 144/293] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:05:27 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/users/c8bf56d4399f41bf87c45f3c11f8bb7d/roles/b798abe95151444282972e4493b211fe => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:05:27.384042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade86835-fded-43ed-99d3-22fdd9fadbeb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:27.421671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:27.422334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.422616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.422893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:27.423812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=0347d7ecfe9b4bd1a18897549ba29303) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:27.424124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:27.425668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89564edc-a16c-40d2-bb16-bfccfb51671a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:27.432600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 150/294] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:27 2022] GET /identity/v3/role_assignments?user.id=0347d7ecfe9b4bd1a18897549ba29303&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=c64fac755de048df8f44054c01499e8f => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:27.975935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106880-a2e8-40ee-9d28-966ba81cd258 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.976927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106880-a2e8-40ee-9d28-966ba81cd258 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.977455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106880-a2e8-40ee-9d28-966ba81cd258 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:27.979312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 145/295] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:27.985796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95bfcf-bfc6-4d2e-bee5-4475603b6ac6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:27.986752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95bfcf-bfc6-4d2e-bee5-4475603b6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:27.987227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95bfcf-bfc6-4d2e-bee5-4475603b6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.007431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dc95bfcf-bfc6-4d2e-bee5-4475603b6ac6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:28.008661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dc95bfcf-bfc6-4d2e-bee5-4475603b6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:28.077987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 151/296] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:28.101502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106880-a2e8-40ee-9d28-966ba81cd258 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.184187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca58c4-9e54-4af7-93d6-3115b3421c92 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.184505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca58c4-9e54-4af7-93d6-3115b3421c92 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.185301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca58c4-9e54-4af7-93d6-3115b3421c92 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.187137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 152/297] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:28.192474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.193003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.193510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.211297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:28.212964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:28.213344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106880-a2e8-40ee-9d28-966ba81cd258 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.254790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.255853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.256136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.256406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.269933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:28.280020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:28.280888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:28.282343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 146/298] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:28.289246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 153/299] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:28.289368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.306401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.397060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b390-e8fc-498e-8970-cb165c46a3da None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.415626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a31c-97c5-4dd7-87ef-747395f7abdb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.438816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.439483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.439766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.440362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.441410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:28.441712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:28.443277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:28.451582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.452708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.453199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.453696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.454115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 147/300] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:28.455492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:28.457137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:28.459098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.459423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 154/301] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:28.465041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.569442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef653f35-e54c-4ab8-a17f-e66a1eeec51a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.587096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a1d85-4acb-4332-8b1b-f8b737ca391d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.603643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.604604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.605081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.605582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] PATH_INFO: `/v3/groups` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.606964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:28.608606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:28.625876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.626795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.627133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.627408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] PATH_INFO: `/v3/users/f8567e6fd7e14766b74d06622bc31723` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.629831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 155/302] 10.222.0.13 () {60 vars in 1134 bytes} [Mon May 16 22:05:28 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:28.651982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] RBAC: Authorizing `identity:get_user(user_id=f8567e6fd7e14766b74d06622bc31723)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:28.652471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b2e88-9759-4c26-8aff-dad65685f86a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:28.654956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 148/303] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/users/f8567e6fd7e14766b74d06622bc31723 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:28.662533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.683591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe76fc-f7ba-4a12-b2ea-22f752952d4b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.683884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe76fc-f7ba-4a12-b2ea-22f752952d4b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.684162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe76fc-f7ba-4a12-b2ea-22f752952d4b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.686466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 149/304] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:28.692423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.692772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.693242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.719574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:28.721382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:28.778643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f69737-9e96-46e4-bb5a-afb958e01e23 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.807748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 150/305] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:28.822978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.824017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.824505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.824952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:28.826177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, user.id=f8567e6fd7e14766b74d06622bc31723, scope.system=all) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:28.826719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:28.828412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:28.830502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:28.843743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 156/306] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/role_assignments?user.id=f8567e6fd7e14766b74d06622bc31723&scope.system=all&role.id=b798abe95151444282972e4493b211fe => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:28.950647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a77a3a-6f88-4ed6-9257-6c9f753557d9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:28.987900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:28.988765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:28.989053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:28.989395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.001606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:29.012168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:29.013176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:29.014032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:29.014615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 151/307] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:29.022157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:29.132894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4da9-4c28-4db4-abb5-5067ae238a1b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:29.165502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:29.166213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:29.166505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:29.166786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.167534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:29.167843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:29.169891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:29.178447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 157/308] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:29.184005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:29.284460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8050a-a0c8-48c4-b2ce-47cb27af8ac7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:29.319226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:29.320102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:29.320381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:29.320653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] PATH_INFO: `/v3/users/7b90e67072524d6bba59d47a7f55a68b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.321862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] RBAC: Authorizing `identity:get_user(user_id=7b90e67072524d6bba59d47a7f55a68b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:29.323296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842ae8-4cec-4041-8a26-53c503caeffc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:29.325763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 152/309] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:29 2022] GET /identity/v3/users/7b90e67072524d6bba59d47a7f55a68b => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:29.334529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:29.444141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8fc8-f91d-4272-9cac-22a76e5329c6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:29.478783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:29.479714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:29.480003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:29.480278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] PATH_INFO: `/v3/system/users/7b90e67072524d6bba59d47a7f55a68b/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.481923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b90e67072524d6bba59d47a7f55a68b, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:29.483333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde62c-3131-4bd4-b5dc-3b507bcdb274 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:29.495207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 158/310] 10.222.0.13 () {58 vars in 1334 bytes} [Mon May 16 22:05:29 2022] PUT /identity/v3/system/users/7b90e67072524d6bba59d47a7f55a68b/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:29.922211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c8d-01eb-4ea5-a395-e11423d17a18 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:29.922590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c8d-01eb-4ea5-a395-e11423d17a18 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:29.922765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c8d-01eb-4ea5-a395-e11423d17a18 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.924410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 153/311] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:29.929887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:29.930179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:29.930461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:29.949902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:29.951660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:30.018742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 159/312] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:30.043345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2c8d-01eb-4ea5-a395-e11423d17a18 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:30.146964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2c8d-01eb-4ea5-a395-e11423d17a18 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:30.180477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:30.181304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:30.181589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:30.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:30.192678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:30.200342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:30.201172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:30.201973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:30.205308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 154/313] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:30.207668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:30.303858 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98727f7-5c95-47bf-ab11-fe673531578a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:30.337774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:30.338448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:30.338732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:30.339007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:30.339755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:30.340061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:30.341997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:30.354734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 160/314] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:30.356055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:30.456023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3bb91-562d-4b34-958e-65c9cf7b143e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:30.489074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:30.490104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:30.490386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:30.490664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] PATH_INFO: `/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:30.491909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] RBAC: Authorizing `identity:get_user(user_id=c8bf56d4399f41bf87c45f3c11f8bb7d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:30.493368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:30.494990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 155/315] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/users/c8bf56d4399f41bf87c45f3c11f8bb7d => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:30.501299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:30.599559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768a38-f0be-452d-8209-2f295f21016c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:30.635661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:30.636319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:30.636601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:30.636876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:30.710416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:30.711811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:30.815761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 161/316] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:30.817099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:30.921675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e53ff-fb42-43fd-9d47-13b9cd6854f8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:30.954956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:30.955870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:30.956152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:30.956474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:30.957678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:30.959116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40aa2f-29e4-4091-9dff-3c82c7e35f17 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:30.965423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 156/317] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:30.967638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.032112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f114f-5551-46da-9b85-ea685583284e None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.032435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f114f-5551-46da-9b85-ea685583284e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.032655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f114f-5551-46da-9b85-ea685583284e None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.035015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 157/318] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:31.040686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590563e-59e6-4573-9dae-3b3178341661 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.040973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590563e-59e6-4573-9dae-3b3178341661 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.041270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590563e-59e6-4573-9dae-3b3178341661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.068739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2590563e-59e6-4573-9dae-3b3178341661 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:31.070144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2590563e-59e6-4573-9dae-3b3178341661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:31.080928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ed01-29ea-45ee-9d22-e1b70ba0430f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.115483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.116498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.116999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.117498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.118648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, scope.project.id=788e2799d72749ca8172e032fd0c66b2, user.id=c8bf56d4399f41bf87c45f3c11f8bb7d) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:31.119151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:31.120785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:31.127860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 162/319] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:30 2022] GET /identity/v3/role_assignments?user.id=c8bf56d4399f41bf87c45f3c11f8bb7d&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=b798abe95151444282972e4493b211fe => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:31.155096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 158/320] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:31.177941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.190829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c27-1ae9-4169-8a8c-3778f9f8f16b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.191141 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c27-1ae9-4169-8a8c-3778f9f8f16b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.191388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb25c27-1ae9-4169-8a8c-3778f9f8f16b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.192809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 159/321] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:31.198502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.198801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.199054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.216505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:31.217666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:31.296129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edf0e-27a8-4350-821e-43654356a661 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.301546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 160/322] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:31.318076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.335763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.336571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.336856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.337138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.338364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:31.339841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:31.341878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 163/323] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:31.347377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.440443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67777d-377e-4165-b0ca-8eae761b8502 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.472024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973883cf-0d34-43bc-b099-a241d5a6761c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.475965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.476755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.477090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.477394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.487512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:31.495259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:31.496095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:31.497080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 161/324] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:31.502045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.506499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.507159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.507440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.507712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] PATH_INFO: `/v3/groups` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.508395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:31.509887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:31.537240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 164/325] 10.222.0.13 () {60 vars in 1134 bytes} [Mon May 16 22:05:31 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:05:31.610479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c90c-9090-4f64-8366-f620d862e42b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.644983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.645709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.645989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.646259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.647008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:31.647310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:31.648699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9840bac-8557-4952-aec1-5c36157f7965 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:31.662876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 162/326] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:31.664352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.753282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471585-0115-4a40-9045-2e7b76347d70 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.753488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471585-0115-4a40-9045-2e7b76347d70 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.753765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471585-0115-4a40-9045-2e7b76347d70 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.755117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 163/327] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:31.761338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.761650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.761867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.773104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a92c8-4894-443d-bc58-b88fef1fec3e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.780953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:31.782941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:31.820722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.821637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.821927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.822206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] PATH_INFO: `/v3/users/f8567e6fd7e14766b74d06622bc31723` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.823427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] RBAC: Authorizing `identity:get_user(user_id=f8567e6fd7e14766b74d06622bc31723)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:31.824881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:31.827095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 165/328] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:31 2022] GET /identity/v3/users/f8567e6fd7e14766b74d06622bc31723 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:31.834708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.865145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 164/329] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:31.892797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:31.943363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a189-e520-494a-ada2-3f8b3c939f84 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:31.994467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:31.995748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:31.996038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:31.996317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] PATH_INFO: `/v3/system/users/f8567e6fd7e14766b74d06622bc31723/roles/b798abe95151444282972e4493b211fe` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:31.998396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8567e6fd7e14766b74d06622bc31723, role_id=b798abe95151444282972e4493b211fe)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:32.000543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:32.011553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 166/330] 10.222.0.13 () {58 vars in 1334 bytes} [Mon May 16 22:05:31 2022] PUT /identity/v3/system/users/f8567e6fd7e14766b74d06622bc31723/roles/b798abe95151444282972e4493b211fe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:32.020915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496b062-6284-41bf-aeeb-fd4ea42acb15 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:32.065251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:32.066521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:32.067000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:32.067525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:32.080999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:32.089852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:32.090787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:32.091648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:32.094593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 165/331] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:32.102615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:32.226418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b54804-832b-4b71-a439-d357b9952327 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:32.264097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:32.264704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:32.264989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:32.265330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:32.266088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:32.266392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:32.267778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:32.276957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 167/332] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:32.282805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:32.387675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975279f2-4ecf-459d-bac3-9a40fdb052fa None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:32.422404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:32.423663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:32.424165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:32.424652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] PATH_INFO: `/v3/users/7b90e67072524d6bba59d47a7f55a68b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:32.426124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] RBAC: Authorizing `identity:get_user(user_id=7b90e67072524d6bba59d47a7f55a68b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:32.427768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b14fdf-5294-47a7-ba76-5cf261cb189d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:32.429671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:32 2022] GET /identity/v3/users/7b90e67072524d6bba59d47a7f55a68b => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:32.436556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:32.549686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f35ef7-4ab1-4de0-9fdd-a8605791babc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:32.598888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:32.599897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:32.600380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:32.600871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:32.601936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] RBAC: Adding query filter params (role.id=c64fac755de048df8f44054c01499e8f, user.id=7b90e67072524d6bba59d47a7f55a68b, scope.system=all) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:32.602469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:32.604110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879270-49a1-45ec-9bb5-161731b70058 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:32.623919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 168/334] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 22:05:32 2022] GET /identity/v3/role_assignments?user.id=7b90e67072524d6bba59d47a7f55a68b&scope.system=all&role.id=c64fac755de048df8f44054c01499e8f => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:34.578770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0121e-57ea-48fa-a493-c33db3649ebc None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:34.579778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0121e-57ea-48fa-a493-c33db3649ebc None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:34.580258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0121e-57ea-48fa-a493-c33db3649ebc None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:34.582236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 167/335] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:34.587385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e195-5da6-427b-bf28-9833af4fe6ec None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:34.588241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e195-5da6-427b-bf28-9833af4fe6ec None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:34.588710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e195-5da6-427b-bf28-9833af4fe6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:34.610457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-33c2e195-5da6-427b-bf28-9833af4fe6ec None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:34.611995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-33c2e195-5da6-427b-bf28-9833af4fe6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:34.696308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:34.731778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0121e-57ea-48fa-a493-c33db3649ebc None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:34.764047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80284ad-d7fe-491c-913c-39f67c57fb35 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:34.764655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80284ad-d7fe-491c-913c-39f67c57fb35 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:34.765140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80284ad-d7fe-491c-913c-39f67c57fb35 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:34.766750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 170/337] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:34.777379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:34.777961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:34.779040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:34.809090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:34.811869 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:34.891701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 171/338] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:34.899109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0121e-57ea-48fa-a493-c33db3649ebc None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:34.941821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:34.955017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:34.955852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:34.956133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:34.956406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:34.974455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:34.986756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:34.987653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:34.988398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:34.993557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 168/339] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:34.993984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.071880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c92db-bdfc-47b5-a689-a3d0946c74af None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.113104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.114321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.114828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.115302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.119108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0418a9-dfeb-403b-b6ee-e0864459f6db None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.128871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-402d0a5e-34ff-4d15-b4e9-423c47f7aad1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:35.137180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:35.138129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:35.138906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:35.141418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 172/340] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:35.144219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174635-8916-42cb-bd4c-c09518ce04ff None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.144219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174635-8916-42cb-bd4c-c09518ce04ff None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.144219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174635-8916-42cb-bd4c-c09518ce04ff None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.145758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 173/341] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:35.147197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174635-8916-42cb-bd4c-c09518ce04ff None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.158129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.159053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.159053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.159343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.160105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:35.160409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:35.162056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7696-60f6-45ad-bbaf-648c063661ae None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:35.171404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 169/342] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:35.172682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.172968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.173260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.190488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:35.191676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:35.259457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174635-8916-42cb-bd4c-c09518ce04ff None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.259773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 170/343] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:35.260641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.294952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.296026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.296527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.296994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.297963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:35.298463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:35.300027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:35.309504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 174/344] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:35.317273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.415076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad37ba2-5ca4-45a6-8e8c-a28db8919250 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.488486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.489164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.489480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.489738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.496751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dcfb-32fb-488a-ac52-3d56ec0d4163 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.578904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.579572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.579855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.580128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.611075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:35.612985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:35.726310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:35.727796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:35.749163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 171/345] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:35.750037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.880246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a024ee0-2e3f-4bd1-8124-142475a3e82b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:35.885067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 175/346] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:35.886156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:35.921757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:35.922555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.924639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.924639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.938989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-0ba510fa-4ca3-4d9f-bb35-7b75232759d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:35.949038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:35.950648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 22:05:35.951508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:35.952751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 172/347] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:35.954042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197f14-0d11-4446-a689-c34935dbd441 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.954324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197f14-0d11-4446-a689-c34935dbd441 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197f14-0d11-4446-a689-c34935dbd441 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 173/348] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341aeb-c451-40c3-9151-6c69eb359069 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341aeb-c451-40c3-9151-6c69eb359069 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341aeb-c451-40c3-9151-6c69eb359069 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 174/349] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:35.961701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341aeb-c451-40c3-9151-6c69eb359069 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.021902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34406b38-afe5-4f3f-a9b8-ea63d25a0431 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.067944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.068808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.069082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.069457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.070657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.072123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.079656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 176/350] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.079656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.081587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341aeb-c451-40c3-9151-6c69eb359069 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.122991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.124014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.124357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.124702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.126049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.127505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55babfad-939b-4d9c-8d37-3ff1c38d32d6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.130179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 175/351] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:35 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.132011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8fcb4-c427-4f43-9e57-133e4bd62342 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.132267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8fcb4-c427-4f43-9e57-133e4bd62342 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.132549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8fcb4-c427-4f43-9e57-133e4bd62342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.150418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-aeb8fcb4-c427-4f43-9e57-133e4bd62342 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:36.151640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-aeb8fcb4-c427-4f43-9e57-133e4bd62342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:36.210131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b4ba5-70c0-44c9-a83d-49f6f0dfc640 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.233320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 176/352] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:36.234961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19e44-8994-4294-a325-183d6e858084 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.235459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19e44-8994-4294-a325-183d6e858084 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.235934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f19e44-8994-4294-a325-183d6e858084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.252504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-07f19e44-8994-4294-a325-183d6e858084 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:36.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-07f19e44-8994-4294-a325-183d6e858084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:36.254309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.255040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.255563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.255896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.256645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:36.256997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.259465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.270912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 177/353] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.272060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.344342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 177/354] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:36.346264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19e44-8994-4294-a325-183d6e858084 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.400866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7c64d-cb36-43f4-8c3b-bdc7a90c6146 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.444800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.445911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.446280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.446563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.454229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.455741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.460137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 178/355] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.460137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.474203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f19e44-8994-4294-a325-183d6e858084 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.513693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.514755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.515136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.515413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.517620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.519127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.520897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 178/356] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.521760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.604900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd734e-f327-4dc4-9475-5c41750f48da None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.648855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.649863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2eff-181e-4ae7-b7fc-39d7bf27a0c8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.650608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.650897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.651177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.665032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:36.675041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:36.675975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:36.676736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:36.678872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 179/357] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:36.679711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.699354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.700787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.701064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.701811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] PATH_INFO: `/v3/users/f8567e6fd7e14766b74d06622bc31723` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.702768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] RBAC: Authorizing `identity:get_user(user_id=f8567e6fd7e14766b74d06622bc31723)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.704237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.707351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 179/358] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/users/f8567e6fd7e14766b74d06622bc31723 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.707351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.796544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72ea1-4668-4704-8bff-78dcf362adb5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.820917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8277-85df-4512-be85-a0757ea10f39 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:36.833659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.834752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.835213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.835495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.848060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:36.855799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:36.857240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:36.858033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 180/359] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:36.858695 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:36.862777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:36.863438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:36.863720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:36.863991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:36.864830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=59159f86fa0b4eea94aabb3abf755add) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:36.865140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:36.867400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:36.874560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 180/360] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:36.875374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.005167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e6f7-a39d-4e6b-9334-fefd0aaae60b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.012798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b7ab0-bcd0-4aed-bbf9-65198f975b0a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.052726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.053431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.053714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.053988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.054839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=59159f86fa0b4eea94aabb3abf755add) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:37.055147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.056626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb765c-dc10-4d0c-ace8-0749d449d7f2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.060860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.061578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.061867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.062133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.062885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:37.063189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.064961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.069776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 181/361] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=c64fac755de048df8f44054c01499e8f => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:37.069776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7780-c532-486a-9e8c-c9a2d6db5592 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.069776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7780-c532-486a-9e8c-c9a2d6db5592 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.069776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e7780-c532-486a-9e8c-c9a2d6db5592 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.071948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 182/362] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:37.071948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e7780-c532-486a-9e8c-c9a2d6db5592 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.084726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 181/363] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:37.085593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.195455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e7780-c532-486a-9e8c-c9a2d6db5592 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.223233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818192aa-c6bf-4e67-853d-df2ceb35063e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.235223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.236074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.236281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.236556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.237460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] RBAC: Adding query filter params (role.id=b798abe95151444282972e4493b211fe, user.id=f8567e6fd7e14766b74d06622bc31723, scope.system=all) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:37.237780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.239380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec0c73-9b2d-47d7-be3a-f624fc536ac1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.253295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 183/364] 10.222.0.13 () {56 vars in 1308 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/role_assignments?user.id=f8567e6fd7e14766b74d06622bc31723&scope.system=all&role.id=b798abe95151444282972e4493b211fe => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:37.254521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.254817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.255095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.267360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.269694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.270290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.270771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.271750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:37.272272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.273922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.285507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 182/365] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:37.286804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.289084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:37.290430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:37.387423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 184/366] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:37.388621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.436078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57a8fb-023a-455c-b5fd-2377ef39a7ae None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.504003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.504598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.504883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.505161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.564452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e89cd5-ff43-4f0d-b9ff-2e43aafe2a48 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.607351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.609138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.620245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.620970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.621282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.621613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.706783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:37.708413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:37.723593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 183/367] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:37.725084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.827901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 185/368] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:37.828724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.870374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5792a-5b9a-4f99-b538-36612ae3cd80 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.914470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:37.915272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:37.915555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:37.915827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:37.933173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:37.944025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:37.944970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 184/369] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:37.945819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:37.954037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5465cda-eeca-4aff-b4d8-6920665a1833 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:37.999561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.000433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.000714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.000987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.002777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.004375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.007287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 186/370] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.008062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.065702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5e1a-93a7-4c75-8426-60b264a9e802 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.101059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.102091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.102394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.102783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.103989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.106017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.110497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 185/371] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:37 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.110497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.129333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519ff9e-f6b6-40b2-bc82-5662e7a23dfc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.170917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.171976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.172550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.173030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.174130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:38.174687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.176332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.186161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 187/372] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.187455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.228939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac6a0-e93b-4060-a1da-6cdb21a66ee3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.269667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.270296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.271025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.271304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.272488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.274612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.276853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 186/373] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.277813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.298770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03be15-48fd-4607-be58-8a42aa45a1ed None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.338064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.339336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.339874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.340349 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.342381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.344062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.346095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 188/374] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.347988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.403709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967e9e2-3d2f-4159-bb89-3a032fd926d2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.446787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.447842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.448739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.449249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.460701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae73d-6966-4451-85d3-97602c1c2928 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.500496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.501159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.501496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.501779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.502612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=788e2799d72749ca8172e032fd0c66b2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:38.503199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.504487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.510286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 189/375] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.511169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.539250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.541874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.627660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539375-719c-4af9-885e-9d1fedd2b15f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.681716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.682410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.682696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.682974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.683835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=788e2799d72749ca8172e032fd0c66b2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:38.684153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.686189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.688757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 187/376] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:38.694224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:38.700483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 190/377] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=c64fac755de048df8f44054c01499e8f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.835005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc852e-aa50-425d-bdd6-30ee9ac3f1fe None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:38.878782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:38.879582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:38.879865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:38.880140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] PATH_INFO: `/v3/projects/8d531649a1e149a58421310daa30d4f0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:38.884469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] RBAC: Authorizing `identity:get_project(project_id=8d531649a1e149a58421310daa30d4f0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:38.885986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:38.889118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 188/378] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/projects/8d531649a1e149a58421310daa30d4f0 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:38.894618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:39.028592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888f93-bed4-48d0-9399-78f395bfdda5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:39.065137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:39.066374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:39.066886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:39.067359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] PATH_INFO: `/v3/groups/51c5ceb483974a6db438e7193eed0473` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:39.072805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] RBAC: Authorizing `identity:get_group(group_id=51c5ceb483974a6db438e7193eed0473)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:39.074616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387c295-8a7e-4537-9e0e-3a54a91a799f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:39.077010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 191/379] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:38 2022] GET /identity/v3/groups/51c5ceb483974a6db438e7193eed0473 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:39.086335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:39.217444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c145fa-ecb8-4418-bd92-67d4096e77e1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:39.256931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:39.257618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:39.257896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:39.258169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:39.258997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] RBAC: Adding query filter params (group.id=51c5ceb483974a6db438e7193eed0473, role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=8d531649a1e149a58421310daa30d4f0) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:39.259305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:39.260724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3db77-3d40-49fd-b8d0-7012a55774f4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:39.269515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 189/380] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:39 2022] GET /identity/v3/role_assignments?group.id=51c5ceb483974a6db438e7193eed0473&scope.project.id=8d531649a1e149a58421310daa30d4f0&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:39.554248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547d706-d833-4008-9e90-968e7efca300 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:39.554584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547d706-d833-4008-9e90-968e7efca300 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:39.554768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547d706-d833-4008-9e90-968e7efca300 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:39.556357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 192/381] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:39.562285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:39.562565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:39.562835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:39.590352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:39.591604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:39.675844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 190/382] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:39.714578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547d706-d833-4008-9e90-968e7efca300 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:39.878484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547d706-d833-4008-9e90-968e7efca300 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:39.921029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:39.921873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:39.922160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:39.922438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:39.937358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-fd7f9649-fcbe-486c-8cd4-5305c61e80d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:39.945379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:39.946225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:39.947594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 193/383] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:39.952694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.000233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc59c-0e07-4cc8-8c33-9ba916d6ffa5 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.000525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc59c-0e07-4cc8-8c33-9ba916d6ffa5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.000806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc59c-0e07-4cc8-8c33-9ba916d6ffa5 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.002327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 194/384] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:40.008837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.009707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.010560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.030400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:40.032525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:40.119025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619425b8-c264-4dc1-a00e-028e60e17324 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.152204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 195/385] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:40.156180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.157120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.157680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.158367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.158926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:40.159238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.160664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.176824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 191/386] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:40.182082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.195854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.285413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43445e32-8637-48d6-82ae-34efa6ad9085 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.319611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.320842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.321363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.321849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.323271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.325361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.327534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 196/387] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:40.332423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.367617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043abf29-ae9b-415a-a971-ac7ee78d15e1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.438155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.438963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.439245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.439522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.440246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd755d9f-e9cb-4712-bfc3-325b9514ed05 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.465976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:40.473886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:40.474741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:40.475605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:40.476183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.476275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 192/388] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:40.480643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.480935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.481826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.483084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.484533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.486736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 197/389] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:40.487789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.498233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.593344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37528c5-07ff-479f-9c0d-3f2eff5e3514 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.631330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.632232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.632655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.634381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.635268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] RBAC: Adding query filter params (name=member) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:40.636059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.638407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.653967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 193/390] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:40.659835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:40.673485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64884-a1e3-4797-8c77-8e54a489d331 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.715022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.716187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.717973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.718397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.723949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, group_id=dd6fe366f21945d697eeca0bf08dcbf1, role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.726473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.762326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 198/391] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 22:05:40 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:40.825711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b0819-55ea-4626-b24c-2cdec3c37d78 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:40.874045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:40.874995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:40.875284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:40.875558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:40.876917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:40.878409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:40.880100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 194/392] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:40.886179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:41.024268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136091-fc87-4846-a2bb-4821abeb9bd1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:41.070602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:41.071503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.071782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.072652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.073349 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:41.075065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82065a-cfcd-4c7e-b2c1-27c104f0d3ea None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:41.077397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 199/393] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:40 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:41.083023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:41.236902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2cd0-8078-45f1-8c85-5a4c205730a1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:41.287348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:41.288460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.288898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.289337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.291475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=59159f86fa0b4eea94aabb3abf755add, group_id=dd6fe366f21945d697eeca0bf08dcbf1, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:41.293064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:41.311316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59e7e-4fff-4281-b6e1-d061f8ed7fe3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.311907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59e7e-4fff-4281-b6e1-d061f8ed7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.312367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff59e7e-4fff-4281-b6e1-d061f8ed7fe3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.314462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 200/394] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:41.325365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 195/395] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 22:05:41 2022] PUT /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:41.328756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.329269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.329687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.358563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:41.359890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:41.465628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 201/396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:41.501069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:41.618713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7287-2020-4c17-8ed1-2b61a71c4b38 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:41.656796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:41.657644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.657929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.658207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.670117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c3710d51-3f20-4666-b7b8-20e63b1e22ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:41.678123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:41.678973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:41.679717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 196/397] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:41.686662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:41.708875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b155e4a-82aa-4bac-9145-3e9321eee86c None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.709424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b155e4a-82aa-4bac-9145-3e9321eee86c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.709914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b155e4a-82aa-4bac-9145-3e9321eee86c None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.711721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 197/398] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:41.717381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.717926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.718399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.736102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:41.737845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:41.851175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3d25-b4a3-4517-8f22-cc9c009593d3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:41.859785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 198/399] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:41.901495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:41.902192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:41.902478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:41.902761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:41.903602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:41.903919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:41.905378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:41.915964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 202/400] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:41.921572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:41.939092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.089679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce17336-0ce9-4c4f-b87d-4062136848ad None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.115125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401be3-cc0b-4509-abfb-c6178df19a50 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.135420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.136284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.136563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.136837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.141904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.143356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.145367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 199/401] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:41 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:42.150448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.162047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.162785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.163066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.163339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.179697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:42.187437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:42.188359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:42.189126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:42.190229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 203/402] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:42.205231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.285105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874ebf7-f528-41a3-9829-9552d25c23cd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.306175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a01b8a-b5e2-4eaa-b951-7e64b990562b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.318916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.320041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.320468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.320883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.322255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.323902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb061cf-8bc4-4094-a4d3-f0c6bc470c90 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.326372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 200/403] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:42.327788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb162b5-c4d1-4d4b-9d42-5d1ccd273768 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.328288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb162b5-c4d1-4d4b-9d42-5d1ccd273768 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.328760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb162b5-c4d1-4d4b-9d42-5d1ccd273768 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.330227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 201/404] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:42.335143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb162b5-c4d1-4d4b-9d42-5d1ccd273768 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.342546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.343217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.343499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.343777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.344523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:42.344834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.346753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de530225-d8ef-46a7-8d32-615c3a87ddfd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.361279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 204/405] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:42.361279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.361279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.361279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.385426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:42.386742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:42.485235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 205/406] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:42.485235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.502840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb162b5-c4d1-4d4b-9d42-5d1ccd273768 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.576540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.577457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.577741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.578012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.580890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, group_id=dd6fe366f21945d697eeca0bf08dcbf1, role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.582548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.608923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506171ea-50be-4c99-8c4c-a1da043d2672 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.609464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 202/407] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 22:05:42 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:42.610420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.697236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.701223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.701223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.701223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.705235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.705235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.713237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 206/408] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:42.721240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.841344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d81cd-f591-4677-89e6-d0c14c80abcc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.910992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.911910 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.912348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.912641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.918982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd546c6-91be-421d-b048-a96eabe5547c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:42.947390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:42.956353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:42.957407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:42.957714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:42.961224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:42.961224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:42.961224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:42.965225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 207/409] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:42.970921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:42.974613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:42.975452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:42.976205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:42.977265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 203/410] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:42.983812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.133616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d3b2-ff06-4cd2-9916-585f786f2c38 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.199386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac435e-6fc1-45e8-a825-3783d223ca9e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.209884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.211154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.211661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.212155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.217007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] RBAC: Authorizing `identity:create_grant(project_id=788e2799d72749ca8172e032fd0c66b2, group_id=dd6fe366f21945d697eeca0bf08dcbf1, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:43.218883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:43.244101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 208/411] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 22:05:42 2022] PUT /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2/groups/dd6fe366f21945d697eeca0bf08dcbf1/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:05:43.263106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.264210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.264687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.265152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.266212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:43.266756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:43.268843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:43.280441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 204/412] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:43.286830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.395042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc594a-4496-4894-887a-f328d19f359f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.431004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.432252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.432728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.433193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] PATH_INFO: `/v3/groups/51c5ceb483974a6db438e7193eed0473` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.435346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] RBAC: Authorizing `identity:get_group(group_id=51c5ceb483974a6db438e7193eed0473)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:43.437065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecf7cd-debc-41ed-9bc4-0cff9d5853df None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:43.439319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 209/413] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:43 2022] GET /identity/v3/groups/51c5ceb483974a6db438e7193eed0473 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:43.445001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.500352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d145-49f8-4b7d-b0cb-c33cca3aa2b4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.500958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d145-49f8-4b7d-b0cb-c33cca3aa2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.501454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d145-49f8-4b7d-b0cb-c33cca3aa2b4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.503318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 210/414] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:43.518754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.519356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.519855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.551423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:43.552991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:43.569583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5c73c-dd94-47f6-9b0c-a4f6fce27381 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.610648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.612726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.613264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.613787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] PATH_INFO: `/v3/projects/8d531649a1e149a58421310daa30d4f0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.615206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] RBAC: Authorizing `identity:get_project(project_id=8d531649a1e149a58421310daa30d4f0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:43.617314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:43.619589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 205/415] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:43 2022] GET /identity/v3/projects/8d531649a1e149a58421310daa30d4f0 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:43.626325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.655764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 211/416] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:43.681351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.749416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3954-468b-40b9-8db6-cdf62357055e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.781907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89d43d-e180-4378-8399-1940b4cdc84d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:43.793003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.795409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.795692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.795969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] PATH_INFO: `/v3/projects/8d531649a1e149a58421310daa30d4f0/groups/51c5ceb483974a6db438e7193eed0473/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.801613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d531649a1e149a58421310daa30d4f0, group_id=51c5ceb483974a6db438e7193eed0473, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:43.802128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:43.835524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 206/417] 10.222.0.13 () {58 vars in 1442 bytes} [Mon May 16 22:05:43 2022] PUT /identity/v3/projects/8d531649a1e149a58421310daa30d4f0/groups/51c5ceb483974a6db438e7193eed0473/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:05:43.852092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:43.852995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:43.853394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:43.853608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:43.872408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-4e98efef-f387-4017-a3ef-0eedd5b1ad9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:43.881819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:43.882786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:43.883539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 212/418] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:43.890427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:43.999328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d13e1-2c30-442b-8539-e9e424a80443 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.008416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1a34-f6f0-408c-82af-32ab642d8b1b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.008719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1a34-f6f0-408c-82af-32ab642d8b1b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.008985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d1a34-f6f0-408c-82af-32ab642d8b1b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.011719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 213/419] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:44.016203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.016492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.016775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.034853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:44.035567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.036069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:44.036252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.036571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.036849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.037628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:44.037940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.039295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:44.048803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 207/420] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:44.058510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.140373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 214/421] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:44.164467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.182697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a489b-30f5-49b1-a05c-83cbead97a4c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.248226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.249654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.250858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.251281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.333479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.335164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:44.379374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3f08-d46e-4f55-a20c-04dc5e8c6d34 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.444040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 208/422] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:44.455933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.485183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.486248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.486680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.486953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:44.509451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:44.510245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:44.511055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:44.513978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 215/423] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:44.516065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.625083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b78e-debb-4387-871d-3c400f099be2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.640714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98fe0-5735-42f7-907d-4c2b744b8c35 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.661698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.662369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.662697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.662975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.663719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:44.664043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.665413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:44.674310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 216/424] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:44.683176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.710658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.711516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.711843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.712114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.713528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.716620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:44.719640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 209/425] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:44.725945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.834538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5ed8f-1b5f-4d92-893e-ac50b5d8ff99 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.867533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.868186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.868463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.868733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.872595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf49024-f7e3-4c98-9d62-24badf544f79 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:44.916282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:44.917151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:44.917463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:44.917971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:44.920347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.926273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:44.928327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 210/426] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:44.933920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:44.939792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:44.941278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:45.045332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 217/427] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:45.046829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:45.145302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2559-fd2d-4d76-88ef-7f09dda4637c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:45.180327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434e5b-f3cb-478b-983c-4895da2a9a6b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:45.183075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:45.183924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.184227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.184501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] PATH_INFO: `/v3/projects/59159f86fa0b4eea94aabb3abf755add` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.186155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=59159f86fa0b4eea94aabb3abf755add)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:45.187586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:45.189436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 218/428] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:45 2022] GET /identity/v3/projects/59159f86fa0b4eea94aabb3abf755add => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:45.194919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:45.256898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:45.257631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.257915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.258187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.259009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=59159f86fa0b4eea94aabb3abf755add) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:45.259311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:45.260716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:45.271353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 211/429] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:44 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 611 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:45.369904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b545d-0331-4913-9d91-8266b77cb9c0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:45.423200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:45.424010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.424288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.424559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.426763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:45.429155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8cf75-3f02-4307-a26a-aa2b02e5bc20 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:45.431272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 219/430] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:45 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:45.437670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:45.577664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9689d-d69f-473d-995c-0aeced3f8729 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:45.581723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32525c80-d97e-4396-b285-900c6088cc0b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.582253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32525c80-d97e-4396-b285-900c6088cc0b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.582836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32525c80-d97e-4396-b285-900c6088cc0b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.584376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 220/431] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:45.589814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.590100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.590475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.609826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:45.611026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:45.620094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:45.621045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.622084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.622571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.623591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=59159f86fa0b4eea94aabb3abf755add) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:45.624092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:45.625737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:45.638268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 212/432] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:45 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=59159f86fa0b4eea94aabb3abf755add&role.id=c64fac755de048df8f44054c01499e8f => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:45.698972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 221/433] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:45.722785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:45.829906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816635b-3dee-482c-a5ae-add1ad876f54 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:45.870149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:45.871330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:45.872367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:45.872842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:45.884759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:45.893333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:45.894339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:45.895301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:45.897316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 213/434] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:45.903910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.017514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7077e-006a-4a5c-9c11-db0afdf88ad6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.051313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.051996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.052277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.052553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.053340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:46.053646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.055121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaa68e-1285-44fd-92a7-e7b071f44477 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.065064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 222/435] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:46.070454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.153945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42f23-488b-4693-9ff2-c97a4c3742e5 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.154453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42f23-488b-4693-9ff2-c97a4c3742e5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.154554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd42f23-488b-4693-9ff2-c97a4c3742e5 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.157265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 223/436] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:46.161432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.161720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.161993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.177518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1be86-a534-401f-8bf2-b808c0899b4d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.179007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:46.180199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:46.218011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.218671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.218957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.219235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.266324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 224/437] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:46.286330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.303245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.304706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.398472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea51dd-0032-469a-b445-1cf8a81a5dca None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.415323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 214/438] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:46.421141 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.432507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.433327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.433609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.433882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.443952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9d4dd79a-2aa6-4436-b89c-b0e51c6ca443 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:46.452148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:46.452996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:46.453813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 225/439] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:46.458571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e6b3-6c6e-4c64-8be2-9c8e911e0496 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.458855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e6b3-6c6e-4c64-8be2-9c8e911e0496 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.459130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4e6b3-6c6e-4c64-8be2-9c8e911e0496 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.460533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 226/440] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:46.461096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4e6b3-6c6e-4c64-8be2-9c8e911e0496 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.516832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc47ed-c95c-4188-b510-f27861bafb8d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.557468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4e6b3-6c6e-4c64-8be2-9c8e911e0496 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.565157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.566052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.566332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.566606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.567876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.569446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabfa55-5343-43e4-9e55-71b022e303a4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.571139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 215/441] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:46.572279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.572569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.572841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.588662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:46.589601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.589891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:46.590899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.591199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.591475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.592223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] RBAC: Adding query filter params (name=member) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:46.592528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.593923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.602285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 227/442] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:46.603084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.651818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 216/443] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:46.652645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.699160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228d6a-3366-436d-9f3e-137d0bc93c1f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.731032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.731872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.732150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.732422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.733600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.735042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.736642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 228/444] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:46.738080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.745281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325e13b-e906-493a-890d-69ea680bcf47 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.777151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.778359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.778640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.778914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.832015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c313-4d71-4f7f-a5ac-6978c5a94838 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:46.842012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:46.843468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:46.863931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:46.864738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:46.864998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:46.865297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:46.875307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:46.883386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:46.884441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 229/445] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:46.885474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.941812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 217/446] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:46.942660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:46.991899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12385e58-f337-4254-83e4-7e72c6192fa7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.023963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.024628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.024909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.025185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.026042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=788e2799d72749ca8172e032fd0c66b2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:47.026353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.027816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.033376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 230/447] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:47.033930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c5e44-89d9-4aaa-9845-2658bb1eca6d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.034146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.070707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.071400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.071684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.071960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.072714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:47.073021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.074493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.083835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 218/448] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:47.089318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.143818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f13c1-3fb2-4149-903e-9e870925d626 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.178387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.179257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.179547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.179824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] PATH_INFO: `/v3/projects/788e2799d72749ca8172e032fd0c66b2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.181053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=788e2799d72749ca8172e032fd0c66b2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.182644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.189002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 231/449] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/projects/788e2799d72749ca8172e032fd0c66b2 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:47.189976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.197591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e007407-2065-4510-94c9-a969400f5d97 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.233147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.233847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.234123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.234396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.299592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13129e8-aa2c-4bb4-8d5b-51ec975df6d4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.305618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.307085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.335952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.336739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.337031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.337344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] PATH_INFO: `/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.338508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] RBAC: Authorizing `identity:get_group(group_id=dd6fe366f21945d697eeca0bf08dcbf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.339929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.342129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 232/450] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/groups/dd6fe366f21945d697eeca0bf08dcbf1 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:47.347795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.398393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 219/451] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 22:05:47.404310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.440354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba5c5-0a86-474c-a1b2-1fef3c5313da None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.471206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.471850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.472143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.472418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.473263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] RBAC: Adding query filter params (group.id=dd6fe366f21945d697eeca0bf08dcbf1, role.id=c64fac755de048df8f44054c01499e8f, scope.project.id=788e2799d72749ca8172e032fd0c66b2) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:47.473579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.475007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.480588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 233/452] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/role_assignments?group.id=dd6fe366f21945d697eeca0bf08dcbf1&scope.project.id=788e2799d72749ca8172e032fd0c66b2&role.id=c64fac755de048df8f44054c01499e8f => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:47.493750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79d37-011e-4e4f-aa0c-ae094e1817d6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.529451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.530315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.530599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.530872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] PATH_INFO: `/v3/projects/8d531649a1e149a58421310daa30d4f0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.532092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] RBAC: Authorizing `identity:get_project(project_id=8d531649a1e149a58421310daa30d4f0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.533577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.535319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 220/453] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/projects/8d531649a1e149a58421310daa30d4f0 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:47.542657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.643591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce38b4-bacc-4bfb-bd61-cfced67fca8f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.678334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.679190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.679472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.679749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] PATH_INFO: `/v3/groups/51c5ceb483974a6db438e7193eed0473` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.680912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] RBAC: Authorizing `identity:get_group(group_id=51c5ceb483974a6db438e7193eed0473)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.682449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8530334-607d-464c-8e32-2cbb804a7db0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.684068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 234/454] 10.222.0.13 () {56 vars in 1180 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/groups/51c5ceb483974a6db438e7193eed0473 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:47.689911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:47.785320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ba3-1dc9-494f-ae76-9c566d865882 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:47.818874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:47.819529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:47.819818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:47.820093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:47.820914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] RBAC: Adding query filter params (group.id=51c5ceb483974a6db438e7193eed0473, role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=8d531649a1e149a58421310daa30d4f0) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:47.821251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:47.822704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46750cee-f8e5-470f-8697-295f1911b927 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:47.828513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 221/455] 10.222.0.13 () {56 vars in 1376 bytes} [Mon May 16 22:05:47 2022] GET /identity/v3/role_assignments?group.id=51c5ceb483974a6db438e7193eed0473&scope.project.id=8d531649a1e149a58421310daa30d4f0&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:50.530964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8ff-57b0-48fc-b969-79d2819b91b0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.531478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8ff-57b0-48fc-b969-79d2819b91b0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.531551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d8ff-57b0-48fc-b969-79d2819b91b0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.533067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 235/456] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:50.538547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b61-bc23-4cf7-9233-74db72fa3125 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.539349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b61-bc23-4cf7-9233-74db72fa3125 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.539825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a66b61-bc23-4cf7-9233-74db72fa3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.566151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e8a66b61-bc23-4cf7-9233-74db72fa3125 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:50.567668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e8a66b61-bc23-4cf7-9233-74db72fa3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:50.651512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 222/457] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:50.697280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2d8ff-57b0-48fc-b969-79d2819b91b0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:50.866921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2d8ff-57b0-48fc-b969-79d2819b91b0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:50.898329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a486c-78e4-496e-9f31-2a4cec358a55 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.898987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a486c-78e4-496e-9f31-2a4cec358a55 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.899462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a486c-78e4-496e-9f31-2a4cec358a55 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.901249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 223/458] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:50.904508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f00d8-bd44-4c6a-91ab-b147c7ab8bff None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.904797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f00d8-bd44-4c6a-91ab-b147c7ab8bff None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.905074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f00d8-bd44-4c6a-91ab-b147c7ab8bff None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.907232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 224/459] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:50.908882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.909161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.909474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.919644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:50.920456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.920738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.921009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.929737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:50.931193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:50.931880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:50.933373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7d36af2a-21ec-4e32-a567-1af81b116210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:50.951398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:50.952287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 236/460] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:50.958104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:50.973284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:50.974585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:51.017328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 225/461] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:51.018426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.045233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 237/462] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:51.057967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.144966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300bd1-d572-4f32-9656-a83d7a8de0cd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.178557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.179456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.179819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.180194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.181014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:51.181444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.182911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.188146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361b666-ca5d-4eaa-9d2c-7e34bb4a735f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.195573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 226/463] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:51.196522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.222854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.223916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.224383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.224884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.235595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.237395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:51.256470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:51.257630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:51.258424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:51.258424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:51.258424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:51.258424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:51.260466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 238/464] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:51.261440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.301319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94755438-9b59-448d-8ded-bfba97b0c0fa None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.338056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.338831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.339119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.339743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.353458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.354898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.361918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbfac6-20b0-4847-9752-968ae1b1598d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:51.372897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:51.373984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:51.374871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:51.374871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:51.374871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:51.374871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:51.374871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 227/465] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:51.375231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.400930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.401635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.401917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.402187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.403412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.404845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0ebf7-4fa6-455b-8a0b-a091de40f89c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.424844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 239/466] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:51 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:51.426244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2bf8f-2b5c-43c5-9c78-2f5928c7181f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.426683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2bf8f-2b5c-43c5-9c78-2f5928c7181f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.426959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2bf8f-2b5c-43c5-9c78-2f5928c7181f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.432337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 240/467] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:51.432337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2bf8f-2b5c-43c5-9c78-2f5928c7181f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.509774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dacf14-7d7d-4382-ba81-0dbb8bc3c0cf None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.551148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.551841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2bf8f-2b5c-43c5-9c78-2f5928c7181f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.552919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.553400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.553817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.554693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:51.555167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.556702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41158760-eacd-4698-b93c-1907cfedcd20 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.570364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 228/468] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:51.571926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.572375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.572826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.591952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:51.592182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.592866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.593185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.593542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.594052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:51.594280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:51.594638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.596121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.616156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 241/469] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:51.616424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.677238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 229/470] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:51.677238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.731082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce0f02-0fb4-4b7b-9df1-9e897106d7d9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.770447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.771146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.771595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.771873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.773012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.775022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.779016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311734-e569-41ae-be6b-194c997efe7c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.808163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 242/471] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:51 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:51.809571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:51.821352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.822132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.822511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.822791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.823499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.825609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:51.863444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 230/472] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:51 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:51.945061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4835593-d5c0-4c37-a15a-834cf4329fbf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:51.983094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:51.983920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:51.984204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:51.984479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:51.997630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:51.999179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b694936b-4bae-47c6-85be-74aa1999c168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:52.018923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:52.019841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:52.020665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:52.020665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:52.020665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:52.020665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.020665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 243/473] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:52.029271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:52.031576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919012-b387-4fc0-946c-4c3c4e603064 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.031866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919012-b387-4fc0-946c-4c3c4e603064 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.032145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9919012-b387-4fc0-946c-4c3c4e603064 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.033964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 244/474] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:52.039880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.040183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.040492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.071849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:52.073135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:52.171736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 245/475] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:05:52.195899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:52.202660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbac03-e066-4115-8f26-b8970f3b6b1a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:52.240271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:52.240942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.241243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.241524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.242242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:52.242546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:52.243903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:52.256811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 231/476] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:52.262962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:52.314049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7241-43e6-49f7-804e-c6cb9ccd8887 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:52.356428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:52.357441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.357995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.358281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.359029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:52.360978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:52.368834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.sql.core [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 22:05:52.368834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 22:05:52.368834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [parameters: {'id': '4764cb5ad1e446aa818e399d77e7da2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 22:05:52.368834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 22:05:52.380336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f60bf-bcca-4825-bf08-da7323a4ecc8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:05:52.392029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return ref.to_dict() May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:05:52.393931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application yield resource May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.rollback() May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.force_reraise() May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise self.value May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application session.commit() May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 22:05:52.395304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._prepare_impl() May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.flush() May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._flush(objects) May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application compat.raise_( May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application flush_context.execute() May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rec.execute(self) May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 22:05:52.396346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:05:52.397592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:05:52.398967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [parameters: {'id': '4764cb5ad1e446aa818e399d77e7da2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:52.405954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 22:05:52.407804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.409871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 246/477] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 22:05:52 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:52.409871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:52.443138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:52.443815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.444095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.444366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.445071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:52.446596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:52.480426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 232/478] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:52 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:52.536558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa80f-96df-43b3-8dbf-54ab0025d1f9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:52.572370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:52.573181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.573492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.573762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.585082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-4550809b-a4a2-4e6d-962f-1f6e874f4043 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:52.593668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:52.595791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:52.597734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 247/479] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:05:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:52.602474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:52.730203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773c961-d38e-4d7c-9636-415592940005 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:52.764982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:52.765703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:52.765986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:52.766259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:52.767002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:52.767308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:52.768674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c76cf0-ec76-45b1-be28-52f6323b2fef None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:52.777188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 233/480] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:54.206240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8efb1f-8960-451c-9c90-ec5b8ef344d6 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.207244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8efb1f-8960-451c-9c90-ec5b8ef344d6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.207748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8efb1f-8960-451c-9c90-ec5b8ef344d6 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.209617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 248/481] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:54.214539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50261-905e-456c-ba0d-2210af09da43 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.215394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50261-905e-456c-ba0d-2210af09da43 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.215884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50261-905e-456c-ba0d-2210af09da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.237163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-13d50261-905e-456c-ba0d-2210af09da43 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:54.238726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-13d50261-905e-456c-ba0d-2210af09da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:54.319087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 234/482] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:54.364381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8efb1f-8960-451c-9c90-ec5b8ef344d6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:54.507161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8efb1f-8960-451c-9c90-ec5b8ef344d6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:54.558871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:54.559681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.559960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.560231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.564430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989057-a8d0-4b8d-8dbe-4d5de9c781d1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.564958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989057-a8d0-4b8d-8dbe-4d5de9c781d1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.565464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989057-a8d0-4b8d-8dbe-4d5de9c781d1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.568060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 235/483] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:05:54.571183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:54.571909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.572203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.572515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:54.578970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:54.579833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:54.581122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 249/484] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:05:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:54.585889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:54.607070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:54.608247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:54.693144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c338ac-e576-4ba1-9012-99ed00711163 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:54.729403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:54.730073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.730354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.730659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.731403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:54.731704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:54.733074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:54.740993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 236/485] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:54.747317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 250/486] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:54.752523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:54.772321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:54.871254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eddb6-f7b5-44d7-9859-762f5190e423 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:54.910356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:54.911607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.912395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.913044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.919570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd649b-c179-4ca5-9875-64e69520715d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:54.926508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f46de836-8d6e-4d42-aaed-8199822c44e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:54.937711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:54.938971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:54.940236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:54.942774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 251/487] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:05:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:54.944774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6717df-6772-4755-b832-b14d2a743bc5 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.945530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6717df-6772-4755-b832-b14d2a743bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.945965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6717df-6772-4755-b832-b14d2a743bc5 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.952112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 252/488] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:54.952112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6717df-6772-4755-b832-b14d2a743bc5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:54.964763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:54.966198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:54.966681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:54.967169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:54.981763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:54.984117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-65dbd205-93a5-4948-b374-a3c39e1a833b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:55.008785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.009849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.010663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:55.010663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:55.010663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.010663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:55.012805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 237/489] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:55.014230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.014725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.015189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.031808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:55.033315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:55.057123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6717df-6772-4755-b832-b14d2a743bc5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.092127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.092845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.093132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.093450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.094247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:55.094592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.096086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.106356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 253/491] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:55.106545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.106781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 238/491] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:55.110694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.209188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459014f3-1a8c-4fef-8a27-dcb403fc1b0a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.226260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7d8de-9d8b-4f5a-85de-ed64385734da None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.247423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.248153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.248439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.248720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.249495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:55.249806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.251216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.265003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 254/492] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:55.265998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.268525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.269908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.270395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.270858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.282291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.284039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:55.301780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.302636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.303455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:55.303455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:55.303455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.303455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:55.305685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 239/493] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:55.306686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.367041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfb4be-050f-488d-bcd4-99b6460f9b72 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.402716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.403572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.403854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.404130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.406643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d7fe8-2368-41ea-8232-c7919164c5a5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.414517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:55.422360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.423239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:55.423988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 255/494] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:55.424640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.447574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.448366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.448648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.448922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.456443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.457908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-7d3ba00f-ece7-40ef-9b8d-665663630c99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:05:55.473049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.473961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:05:55.474868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:55.477295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 240/495] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:55.478872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb25-22cf-4b9f-8598-b81ffce72801 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.479229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb25-22cf-4b9f-8598-b81ffce72801 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.479568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bbb25-22cf-4b9f-8598-b81ffce72801 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.485262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 241/496] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:55.485262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bbb25-22cf-4b9f-8598-b81ffce72801 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.526117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2fdce-738e-4792-b0c1-2e24fe642484 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.559907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.560673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.561050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.561445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.562366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:55.562794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.564242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.580215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 256/497] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:55.580215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.592962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bbb25-22cf-4b9f-8598-b81ffce72801 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.629841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.630881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.631230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.631566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.632484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:55.632746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.634252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7aeb-cd36-4bdf-aafd-8a011292bf6e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.647609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 242/498] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:55.647609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.647609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.647609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.662533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:55.663727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:55.689240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79d6a-8117-4d03-b7cd-5c076117e836 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.720863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.721556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.721843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.722124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.722952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:55.723262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.724696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.726161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 243/499] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:55.726996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.776824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 257/500] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:55.776824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.819681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960b965-5e8d-44e1-a4da-d0b9622e3a6b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.851755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.852748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.853031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.853329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.860571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.862013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.868042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa4fc-3d9f-4b9c-a079-dd3916a713ca None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-53b3ab26-a1ca-4662-a2a8-76fed416d955 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:05:55.875674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.876538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:55.877434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 244/501] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:55.878430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3ebe-b248-4abb-8462-53446d530ff6 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.878430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3ebe-b248-4abb-8462-53446d530ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.878700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3ebe-b248-4abb-8462-53446d530ff6 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.879924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 245/502] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:55.880854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3ebe-b248-4abb-8462-53446d530ff6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.904010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:55.904802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:55.905080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:55.905390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:55.915777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:55.917341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:55.934816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:55.935757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:55.936577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:55.936577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:55.936577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:55.936577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:55.936577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 258/503] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:55.936849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:55.978666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3ebe-b248-4abb-8462-53446d530ff6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.010847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.011630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.011958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.012235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.022281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:05:56.030448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:56.031818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 246/504] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:56.032742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.036186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803e046-86d7-4d91-8999-b8e001741fd0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.068037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.068669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.068947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.069241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.125356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79455f60-0800-4176-a6d1-d646f7463833 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.132836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.134339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.156639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.157329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.157611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.157884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.158700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:56.159009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.160413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dc45-9c07-48f6-b888-64e4751e3398 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.195716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 247/505] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:56.197107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.197493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.197837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.214792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:05:56.216537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:05:56.226017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 259/506] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:56.226851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.278805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 248/507] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:05:56.279639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.320208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1530f-7ba2-444d-9353-d27129c13011 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.352395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.353050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.353371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.353647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.354362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:56.354666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.356072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.366639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 260/508] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:56.367434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.370410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dd72a-01dd-4495-945b-20a2e04ceb7d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.402327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.403506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.403785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.404056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.404781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:56.405078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.406466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.414022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 249/509] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:56.414809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.460246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd286d6a-26f3-44af-a7a9-9ec9a5532d47 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.492044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.492678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.492958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.493258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.504548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b4596-1f20-4dd0-93ba-c13757fb9cb7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.535852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.536616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.536895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.537162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.546970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.548377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.556168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.557657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:56.564328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:56.565309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:56.566168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:56.566168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:56.566168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.566168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:56.566168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 250/510] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:56.566550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.650754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 261/511] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:56.651679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.660977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954619-83dc-40dd-8ef4-b286ee64f6d3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.692793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.693736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.694024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.694303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.704941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.706424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:56.722604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:56.723636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:56.724660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:56.724660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:56.724660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.724660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:56.724660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 251/512] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:56.724992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.745716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ba158-6156-482f-a4b2-cfdb9ad10eba None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.778913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.779705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.779988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.780265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] PATH_INFO: `/v3/users/glance` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.787034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.788466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:05:56.803838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:56.804844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 262/513] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:56.805940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.821506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886df8bf-66cf-488b-b298-a921f0502b39 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.855685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.856467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.856746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.857015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.867722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.869166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:56.885946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:56.887570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 252/514] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:56.888574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.903419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a238-91fc-46cc-bf32-da94308df37b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:56.945843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:56.946515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:56.946863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:56.947231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:56.948045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:56.948436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:56.950565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:56.961555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 263/515] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:56.962355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:56.980326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1645b-1320-45c4-82b8-3dd0a4fad5a7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.012803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.013627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.013913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.014187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.024031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.025489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:57.041550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:57.042559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:57.044063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:57.044063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:57.044063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:57.044063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:57.046009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 253/516] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:57.046243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.054802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cc315-8620-4ad7-b42d-4c43b45cb297 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.086178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.086826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.087104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.087377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.088086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.088387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.089782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.100746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 264/517] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:57.101545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.143164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de5e-22db-4d67-a74c-cf8d496433b6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.174610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.175277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.175558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.175833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.176654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.176964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.178411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.193998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e68f7f-b554-45cc-8336-5acb391640e2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.195135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 254/518] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:57.196097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.229869 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.231034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.231322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.231596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.232315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.232618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.234012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.244752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 265/519] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:57.245373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.291861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75037409-d447-47eb-8073-b356b27f40b7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.331836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.332625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.332908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.333183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.339722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.341692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.348645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a39a2-9b8e-4603-8564-a6335b5060e4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:05:57.355371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:57.356929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 255/520] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:57.357943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.381076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.381758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.382039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.382313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.383024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.383480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.384863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.395916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 266/521] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:57.396693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.454951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada89a-541b-4a67-9707-978b619d836c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.485184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.485869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.486150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.486422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.487108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.488537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.489335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e2fe6-fc89-444d-83de-d448cbc664a2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.508085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 256/522] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:05:57 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:05:57.509089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.528999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.529706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.529992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.530269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.608264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.609832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.622175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22f4b-f3ac-441e-9258-c2000afd46ab None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.658494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.659313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.659600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.659877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.668188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.669717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:05:57.685180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:57.686157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:05:57.687041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:57.689460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 257/523] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:57.690189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.714815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 267/524] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:57.715780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.794394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ac974-757c-4aef-8036-cefad79c0221 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.825458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d985d-d397-49bc-91b9-9f397be0091e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.827184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.827846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.828126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.828403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.829177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.829519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.830935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.848539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 258/525] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:57.849229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.865341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.866133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.866414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.866684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.873862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.875316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:05:57.890505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:57.891377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:57.892191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:57.893522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 268/526] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:57.894566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:57.947254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907f58-d069-45b2-9317-4f89fd769430 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:57.979117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:57.979748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:57.980031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:57.980300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:57.981802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:57.982106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:57.983521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:57.992448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518348e-8772-41e5-8bb4-f8f74373f75f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.004574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 259/527] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.004574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.029428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.030249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.030535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.030811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.041383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.042849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:58.062118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:58.062975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:58.063781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:58.063781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:58.063781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:58.063781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:58.063781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 269/528] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:58.064071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.102925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e638dd-df94-4e38-ab9f-ce9f08e4d33b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.135775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.136438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.137780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.137780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.137975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.138186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.139544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.144871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 260/529] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.145697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.172149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99987f8d-4dae-423a-95ba-d5ee599636f7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.208825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.209939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.210444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.210943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.211968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.212565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.214378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.236411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 270/530] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.238109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.253171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1062-f498-404e-b089-d69f14e46bd0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.289800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.290223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.290457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.290736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.349839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30017b8d-3d7f-42c6-9f62-7a4325549e7c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.362918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.364398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.383471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.384137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.384420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.384696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.385465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.385770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.387214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.403528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 271/531] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.404426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.469650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 261/532] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:05:58.470564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.503272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1006a2-9b87-4776-9bc0-826a300ea5bf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.536001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.536655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.536935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.537219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.538051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=4e8bbada4fbb48a186e373ac378e1fda) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.538364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.539791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.553398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 272/533] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/role_assignments?user.id=4e8bbada4fbb48a186e373ac378e1fda&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.554439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.572489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f746-106f-4f62-be93-6669f1422813 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.608244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.609061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.609379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.609654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.617135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.618707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:05:58.634428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:58.636334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:05:58.638014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 262/534] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:58.650350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.695816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155221-b591-40ed-9036-8f5e6395e3c1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.732547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.733388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.733669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.733939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.745784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.747320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:05:58.775037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:58.775881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:58.777145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:05:58.777145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:05:58.777145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:05:58.777145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:58.777145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 273/535] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:05:58.782569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.838691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b0afc-fbbe-4e76-b3d2-e9a8e8576cd5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.876689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.877416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.877703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.877985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.878776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.879085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.880785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.887487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfb398-c876-4551-90c2-d6d221c7d4ff None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:58.894347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 263/536] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:58.902211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:58.927551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:58.928383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:58.928725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:58.929097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:58.929956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:58.930325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:58.931771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:58.944322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 274/537] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:05:58.950186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:59.017850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad81a-39dc-4a40-929b-6b059edc4989 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:59.056296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:59.057150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.057474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.057757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:59.059570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=fa8d29f2955b4edaa93ecdd798ea4f62) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:59.059891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:59.061469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:59.069890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 264/538] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/role_assignments?user.id=fa8d29f2955b4edaa93ecdd798ea4f62&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:59.114090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c49257-85be-406b-ae40-1cb21fa48d54 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:59.153321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:59.154123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.154402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.154676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:59.161666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:59.163225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:05:59.178467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:05:59.180586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:05:59.181862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 275/539] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:05:59.185620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:59.333422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9cf05-30a2-4242-8484-777751b123e3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:59.372539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:59.373344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.373509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.373786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:59.374583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:59.374888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:59.376350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c41ee-b830-4162-a1db-0df688cfa795 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:59.391415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 265/540] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:59.397221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:05:59.496866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc47b-4f6a-4f7e-8d3f-b3fe3c9468a9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:05:59.531063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:05:59.531721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.532001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.532274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:59.533099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=86b0cbde93e04bc2832ec379ccc001c8) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:05:59.533432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:05:59.534860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4ba17-4bd7-40e8-8d2f-d1892f8cdcc7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:05:59.540801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 276/541] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:05:59 2022] GET /identity/v3/role_assignments?user.id=86b0cbde93e04bc2832ec379ccc001c8&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:05:59.990677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7a7d-d7b5-4616-af76-dad316743012 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.991049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7a7d-d7b5-4616-af76-dad316743012 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.991213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7a7d-d7b5-4616-af76-dad316743012 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:05:59.992818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 266/542] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:05:59.998218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:05:59.998518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:05:59.998801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.018100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:00.019323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:00.092841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 277/543] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:06:00.115897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf7a7d-d7b5-4616-af76-dad316743012 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:00.242835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf7a7d-d7b5-4616-af76-dad316743012 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:00.288832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:00.289682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:00.289967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:00.290245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.306842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:00.314765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:00.316862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:00.318828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 267/544] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:00.326418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:00.472820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df9a53-2f44-48a6-a3da-083dfa9305df None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:00.507757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:00.508782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:00.509309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:00.509777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.510712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:00.511226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:00.513392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b290b9-0f9f-4c7a-aff8-21526094c715 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:00.521999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 278/545] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:00.527075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:00.670372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2164fa-46f3-4f84-a6fc-ebd7931f4ce1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:00.712645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:00.713817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:00.714321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:00.714841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.720749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d45f-edd4-46a4-952e-e1fd0ad03d3a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:00.721292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d45f-edd4-46a4-952e-e1fd0ad03d3a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:00.721765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d45f-edd4-46a4-952e-e1fd0ad03d3a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.727279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:00.727572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 279/546] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:00.727837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:00.729509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165865-3112-4575-91a5-f692248ff477 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:00.729774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165865-3112-4575-91a5-f692248ff477 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:00.730060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165865-3112-4575-91a5-f692248ff477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:00.753077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c5165865-3112-4575-91a5-f692248ff477 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:00.754724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c5165865-3112-4575-91a5-f692248ff477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:00.757614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:00.758426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:00.759222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:00.759222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:00.759222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:00.759222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:00.765739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 268/547] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:00.774178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:00.837033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 280/548] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:00.858685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165865-3112-4575-91a5-f692248ff477 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:00.965623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165865-3112-4575-91a5-f692248ff477 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.003454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.004620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.005771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.006268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.017466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:01.026779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:01.027690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:01.028466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:01.036073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 281/549] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:01.037551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.038394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc675108-2247-4373-9e53-0bbc5d820add None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.134491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.135189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.135461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.135738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.136470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:01.136829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.138221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.149942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a3fc-6da3-4e02-88be-83071f113962 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.164519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 269/550] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:01.170865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.189941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.191051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.191568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.192059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.193111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:01.193640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.196000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.209930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 282/551] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:01.211959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.312723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877321-4ac5-45c6-9972-431e4f561259 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.351137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.352314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.352794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.353344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.365399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.367143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7378de-c3ac-4ce4-bbd7-ae4acc9a1905 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.367360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:01.384901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:01.385796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:01.386645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:01.386645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:01.386645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:01.386645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:01.393043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 283/552] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:01.394601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.434901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.435787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.435981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.436240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.447505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.449808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:01.484802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:01.485863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:01.487077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 270/553] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:01.491472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.499814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e3d6-9524-4aec-a02f-0edd2b2a98eb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.534499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.535389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.535830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.536239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.537087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:01.537565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.539068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe005a-6a04-403c-9250-3d926f2359a7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.550871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 284/554] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:01.556585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9300-d956-469b-89a3-03551571b1da None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.557039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9300-d956-469b-89a3-03551571b1da None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.557509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad9300-d956-469b-89a3-03551571b1da None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.559412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 285/555] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:01.560243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad9300-d956-469b-89a3-03551571b1da None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.613254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5cc33-9040-41c7-84d2-6af5eac0e615 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.647239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.648134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.648519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.649299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.649994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:01.650405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.652001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2e44-4a6c-42e3-9cb2-d0d29fae2dcb None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.664234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad9300-d956-469b-89a3-03551571b1da None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.673123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 271/556] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:01.674561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.675002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.675369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.692726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:01.694105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:01.702417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.703454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.703935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.704381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.711777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.713465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:01.728482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:01.729424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:01.730400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:01.735878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 286/557] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:01.735878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.778253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 272/558] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:01.779447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.871539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51288-7937-4870-9087-7efa05d3e9ba None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.895408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6aea8-2108-42d3-ae09-810d0f34fac1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:01.906884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.907832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.908140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.908396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.929702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:01.930374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:01.930656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:01.930930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:01.931757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:01.932060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.934077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:01.962723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 273/559] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:01.962723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:01.984850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:01.986529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a5aeb-44d1-47b9-a9e8-782e28019dc2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.059739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737ba0-5909-48e3-a7fa-c86f0548ecef None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.086147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 287/560] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:02.087499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062af6b2-bc56-4b36-b814-83d2c5193c36 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.087789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062af6b2-bc56-4b36-b814-83d2c5193c36 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.088065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062af6b2-bc56-4b36-b814-83d2c5193c36 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.093409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 288/561] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:02.093409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062af6b2-bc56-4b36-b814-83d2c5193c36 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.103551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.104548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.104833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.105103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.115119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:02.123459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.124288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:02.125073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 274/562] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.125745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.196241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062af6b2-bc56-4b36-b814-83d2c5193c36 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.221906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037ded-a738-4c2e-928d-7f795e1af9d4 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.229731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.231043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.231325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.231598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.242025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.243539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.262112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a526f672-76fa-4425-aaa0-83a37066a221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:02.262907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.264231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.265255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:02.265255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:02.265255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.265255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:02.265255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 289/563] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.265535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.266065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.266065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.266928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.267438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.267777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.281919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.283386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.284509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:02.285762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:02.301545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.302451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.303301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:02.303301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:02.303301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.303301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:02.303301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 275/564] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.304102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.360348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 290/565] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:02.361219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.408223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae37c83-abf8-4e76-bf41-7a6bb3dd98ca None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.441159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.441950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.442240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.442515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.443252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:02.443556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.444962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.452657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 276/566] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:02.453462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.462536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642beb-8025-4fad-b0a4-e43c6c7f6cf3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.494193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.494845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.495121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.495390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.496683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:02.496987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.498384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.509396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 291/567] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:02.510076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.549089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cac76-7f10-4240-934f-feb1dd7a8662 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.580331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.580982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.581292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.581573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.582280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:02.582586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.583929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deffdd0-ef98-43cd-adec-454e13446a6b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.595663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 277/568] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:02.596666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73e5f-5a88-4903-a7d8-1b332cf755bd None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.596954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73e5f-5a88-4903-a7d8-1b332cf755bd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.597255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c73e5f-5a88-4903-a7d8-1b332cf755bd None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.598605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 278/569] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:02.599144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c73e5f-5a88-4903-a7d8-1b332cf755bd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.602465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459450b-dc77-4ed0-897c-6ef34d6a4a51 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.642088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.642880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.643164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.643435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.654383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:02.661921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.662835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:02.663632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 292/570] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.664289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.695943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c73e5f-5a88-4903-a7d8-1b332cf755bd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.727389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.728176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.728460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.728735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.738801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.740221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:02.756939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.757958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.759272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:02.759272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:02.759272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:02.759272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:02.759488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed838-cb62-4171-a8cd-b5d330245be7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.759561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 279/571] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.759561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.793697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.794482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.794764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.795037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.801769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.803251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e825a8ce-6d5d-4260-8048-593f1c3cfd54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:02.817170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.818040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:02.818912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 293/572] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.819924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.819924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.820070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.835649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:02.836835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:02.856282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4615be8-9561-4427-83c9-e184ecede055 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:02.887986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:02.888780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:02.889060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:02.889362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:02.895655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:02.897083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:02.899017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 294/573] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:02.899837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:02.921600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:02.922530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:02.923390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 280/574] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:02.923861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:02.999183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16272eea-a4dd-4e96-9ab6-bfe1c8ed524e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.020131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f260-08f8-4fb1-96e7-8126830a8582 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.031215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.031871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.032152 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.032426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.033160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.033495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.034855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.042290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 295/575] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.043096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.052116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.052776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.053056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.053360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.054072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.054374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.055715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.066935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 281/576] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.067728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.136313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fcf12-d9b9-4cd4-8527-ba0071e08258 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.159472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719d5bf-dd7b-4c01-b525-27d532d0dd0a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.167212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.168351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.168634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.168911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.169722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.170032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.171467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.182870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 296/577] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.184124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.191810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.192592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.192871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.193138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.202875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:03.210386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:03.211304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:03.212120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 282/578] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:03.212818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.277053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ffc5-e35b-4410-b384-baf0ae7f8c66 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.304794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa3bd4-1da8-4ff4-8ed2-e7fa6cb73d33 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.309346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.310004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.310271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.310538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.311338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.311642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.313072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.323822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 297/579] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.324622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.336735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.337544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.337827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.338097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.348526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.349965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:03.366658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:03.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 283/580] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:03.373321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.418944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12f7ad-a2a0-4ff4-85c4-81d358ca9306 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.449454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.450238 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.450514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.450780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.457854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.459284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.464148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee6531-8706-4539-b63b-765c820ada4e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:03.473475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:03.474583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:03.475708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:03.477339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 298/581] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:03.478300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.496485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.497389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.497671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.497939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.511501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=dd2eb7a2de50414587c7bd815d401959, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.512937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.525603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 284/582] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:03 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:03.526562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.577304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94f1c-f293-447f-9899-5aa45056fdbb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.613290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.613921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.614202 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.614480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.615248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.615554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.616962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.626311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 299/583] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.627666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.636359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cf5d1-f7df-47cc-b412-e2d2dfbcf95c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.672624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.673325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.673609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.673888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.674741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=d51afc0a8e1949fb8d3e346a97c56ef1) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.675057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.676520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.689424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 285/584] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/role_assignments?user.id=d51afc0a8e1949fb8d3e346a97c56ef1&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.689424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.737434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a47d89-9b73-4c4c-aef5-a65296fc61c9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.774578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.775302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.775588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.775860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.776595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.776899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.779048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.792328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 300/585] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.793335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.819394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66e18-4c4e-466b-af02-8285e7a5b587 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.857094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.858071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.858505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.858929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.859966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:03.860437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.862217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.881507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 286/586] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:03.882657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.901650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953077c3-8422-4645-beed-67a43f6443e5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:03.936435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:03.937305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:03.937586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:03.937856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:03.948095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:03.950212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:03.968381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:03.969514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:03.970577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:03.970577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:03.970577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:03.970577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:03.970577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 301/587] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:03.970860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:03.990948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33b4e3-6064-42ef-9bf7-08e368a2aa6b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.026774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.028444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.028898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.029361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.036860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.038498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:04.053715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.054903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 22:06:04.055896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:04.058072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 287/588] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.059121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.072610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef654f3d-7c96-4713-b528-1f83dd723486 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.107192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.108163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.108283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.108516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.118460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.119919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:04.138511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.139582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 302/589] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.140604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.165850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab22357-0b53-4059-ac77-cb08bbdd16ae None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.204494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.205500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.205927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.206348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.207229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.207679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.209251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.221404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 288/590] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.222420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.238389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb163c-0fe8-4c20-9a8f-196e734ac6ff None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.272894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.273502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.273790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.274064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.274905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.275211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.276643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.294191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 303/591] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.295568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.326608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c422-0a19-4bb6-9a69-ec1fa7c2b16e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.360345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.361322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.361753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.362495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.363394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.363857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.365377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.379020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 289/592] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.380051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.392964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42e5a8-30eb-4599-9385-0326b18cc6dd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.426434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.427236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.427517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.427790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.435774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.437231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:04.452305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.453435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:04.454395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 304/593] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.455061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.489995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ae90b-a5b7-46c2-abab-1d9276702b8f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.525939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.526972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.527432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.527858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.538294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.539909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.552460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804754f-6a6f-469d-8f2b-a0df19c3b760 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:04.558505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.559989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.560943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:04.560943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:04.560943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.560943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:04.562921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 290/594] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.563937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.586325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.587104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.587453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.587652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.594295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.595736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:04.609756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.610761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 305/595] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.611687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.667279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a702f7-cd80-4a36-aefc-0cd1e4e1626d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.702049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.702936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.703390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.703805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.704763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.705232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.706842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.708356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbfb719-b194-40d7-a1a7-ae0a7c0f0245 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.725597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 291/596] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.726713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.743111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.743778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.744345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.744345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.745039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.745372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.747304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.760205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 306/597] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.761239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.832716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156160b-117b-4be4-9c02-a45c1f797208 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.859911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacd8ee-7dda-4574-876b-60d6bbb14921 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:04.868787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.869827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.870266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.870747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.871781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:04.872282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.873947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.887078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 292/598] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:04.888154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.896027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:04.896829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:04.897107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:04.897400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:04.907970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:04.909594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:04.928539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:04.929631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:04.930590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:04.930590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:04.930590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:04.930590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:04.930590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 307/599] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:04.930912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:04.995708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafd444-7fe5-4a09-a79a-faa2b6e7cf60 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.028845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adaf07-b22f-4125-8ad3-199db0138575 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.030851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.031816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.032514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.033157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.044430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.046076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:05.060699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:05.061715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:05.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:05.065163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 293/600] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:05.065860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.066398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.066940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.067325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.067698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/4e8bbada4fbb48a186e373ac378e1fda/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.082268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=4e8bbada4fbb48a186e373ac378e1fda, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.083875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.100819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 308/601] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:04 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/4e8bbada4fbb48a186e373ac378e1fda/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:05.101914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.175940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a520e-5731-4ff3-a59e-0bb1fa1ebc93 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.206422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f67b-105a-4e07-a9d1-2ce74c70513e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.216622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.217923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.218317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.218716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.219935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:05.220640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.222406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.237259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 294/602] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:05.242763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.247512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.248418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.248850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.249298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.250446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:05.250958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.252667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.269741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 309/603] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:05.275030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.420013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988eba-c1a4-4871-b6ee-ebbaf5e0c1e2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.439919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268e1dc-9664-42a3-9caa-8d9453f9c2a9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.462295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.463565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.464064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.464543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.471920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.473835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.474900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.475791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.476072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.476353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/fa8d29f2955b4edaa93ecdd798ea4f62/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:05.490098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:05.490990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:05.491839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:05.494723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 295/604] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:05.500308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=fa8d29f2955b4edaa93ecdd798ea4f62, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.500308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.500545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.526738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 310/605] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:05 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/fa8d29f2955b4edaa93ecdd798ea4f62/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:06:05.609187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd64ee-a7b4-4e5d-8f28-00643236b365 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.646483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.647593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.648172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.648658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.649763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:05.650325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.652052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2a00-ff04-4e70-9513-68fa958f135e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.666427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 296/606] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:05.674168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:05.819701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fac41a-ab5d-436a-92b5-3caa919e448a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:05.859225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:05.860113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:05.860394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:05.860663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/86b0cbde93e04bc2832ec379ccc001c8/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:05.876001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=86b0cbde93e04bc2832ec379ccc001c8, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:05.877503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488e3d2-811f-42ba-866e-d02108a7787d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:05.893671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 311/607] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:05 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/86b0cbde93e04bc2832ec379ccc001c8/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:06.031799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6efe-5850-43fd-b222-6d7bcf8a230a None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.032854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6efe-5850-43fd-b222-6d7bcf8a230a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.033454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6efe-5850-43fd-b222-6d7bcf8a230a None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.035409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 297/608] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:06.041821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a0c6-6ab4-4f20-a547-4869c7994cd5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.042520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a0c6-6ab4-4f20-a547-4869c7994cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.043066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a0c6-6ab4-4f20-a547-4869c7994cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.060949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7b77a0c6-6ab4-4f20-a547-4869c7994cd5 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:06.062771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7b77a0c6-6ab4-4f20-a547-4869c7994cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:06.148704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 312/609] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:06:06.175078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b6efe-5850-43fd-b222-6d7bcf8a230a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.210016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e33af-5bd7-4657-b01f-6f468c9ccae4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.210637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e33af-5bd7-4657-b01f-6f468c9ccae4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.211146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e33af-5bd7-4657-b01f-6f468c9ccae4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.215928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 313/610] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:06.224462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.225032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.225545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.245721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:06.247924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:06.299074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b6efe-5850-43fd-b222-6d7bcf8a230a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.322612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 314/611] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 22:06:06.353356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.355077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:06.356614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.357052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.357503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.376867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:06.388332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:06.389563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:06.390436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:06.392667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 298/612] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:06.398349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.534800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556387-6198-46e9-976e-6c6635754b9b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.570927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:06.571814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.572204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.572584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.586919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:06.595819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:06.596903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:06.597967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:06.599904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba6db-e9ef-40bf-af52-d4ba0a7eb478 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.600155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 315/613] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:06.608915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.661418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:06.662099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.662385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.662663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.663403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:06.663710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:06.665070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:06.683142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 299/614] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:06.694269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.751408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45e55-3cde-4fd9-aff5-d4452e2ad2a4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.794037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:06.796157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.797552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.797991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.800205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:06.800730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:06.802308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:06.821073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 316/615] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:06.827209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:06.892982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e07ccc-1936-45d8-9a23-487663c0ca54 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.968453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:06.970202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:06.970809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:06.972243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:06.981310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec6a6-4a50-4fc0-93f5-fa6cadb5f8f9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:06.993289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:06.994937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:07.028222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:07.029338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:07.030344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:07.030344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:07.030344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:07.030344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:07.032787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 300/616] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:07.039775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.052588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.053476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.053701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.053975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.075686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.077063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:07.102115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:07.103166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:07.104217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:07.104217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:07.104217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:07.104217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:07.109814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 317/617] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:07.114976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.144516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e522-28f6-4552-9845-8726e5029fec None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.177687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.178602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.179043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.179466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.180321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:07.180778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.182364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.194962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 301/618] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:07.200709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.305144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9e2f-8d9e-4f12-8e76-12170c756e2f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.343081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.344110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.344541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.344969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.353069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.355001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:07.371673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:07.372750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:07.373823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:07.376218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 302/619] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:07.382213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.383364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0bef-3780-452b-b7f5-f717723f40d1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.443237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.444338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.444785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.445233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.446126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:07.446594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.448193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.462695 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 318/620] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:07.471631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.535979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafa6c1-11ba-4829-ab00-cfc2df0dc712 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.580351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.581024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.581341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.581606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.582590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:07.582724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.584140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.585686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eaa9d-fc6c-440a-a29a-2041e1d70ea8 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.615947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 303/621] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:07.620537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.621873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.622350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.622881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.623310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.631627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.633410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:07.660782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:07.661962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:07.662897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:07.670893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 319/622] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:07.678150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:07.748765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cccb35-b29a-4284-97e0-ea1f7f958209 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.806741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.807593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.808035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.809042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.894940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c0756-3ba3-46f1-b90b-f75f5045f86f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:07.919945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.921727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b57b9-c7dd-46ed-bdcd-3a81a1371695 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:07.959483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:07.960480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:07.961653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:07.962092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:07.963472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:07.965141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:07.967365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.004770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 320/623] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:08.011673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.079952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 304/624] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 22:06:08.081990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5799b-b21b-4880-a7f3-a722ebcd91c1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.082612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5799b-b21b-4880-a7f3-a722ebcd91c1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.083040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5799b-b21b-4880-a7f3-a722ebcd91c1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.085576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 305/625] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:08.086438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5799b-b21b-4880-a7f3-a722ebcd91c1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.121569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50fbb7-d169-42ea-8bb2-d2c952fe573a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.157172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.158599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.158873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.159147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.173721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.176116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-81be6fbe-dcf4-4f8d-b196-d1cd33e0ac6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:08.196370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.197509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.198394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:08.198394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:08.198394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:08.198394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:08.198394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 321/626] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.200108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8565-6998-46f6-b305-d9ef4ccba2f4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.200108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8565-6998-46f6-b305-d9ef4ccba2f4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.200108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8565-6998-46f6-b305-d9ef4ccba2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.212035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5799b-b21b-4880-a7f3-a722ebcd91c1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.217480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4c3b8565-6998-46f6-b305-d9ef4ccba2f4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:08.218692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4c3b8565-6998-46f6-b305-d9ef4ccba2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:08.248459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.249386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.249677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.249954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.262554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.264171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:08.281454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.282338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.291060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:08.291060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:08.291060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:08.291060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 322/627] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e846-b5b0-4651-8811-22e8139bdba0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e846-b5b0-4651-8811-22e8139bdba0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03e846-b5b0-4651-8811-22e8139bdba0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 323/628] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:08.291289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e846-b5b0-4651-8811-22e8139bdba0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.291691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 306/629] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.291691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.385658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b8ae0-f241-49be-8ee1-d7ecde8d314c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.401133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03e846-b5b0-4651-8811-22e8139bdba0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.418881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.419504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.419791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.420071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.420785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:08.421094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.422483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3385d6-e742-4d76-ad81-320737065cad None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.437911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 307/630] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:08.437911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.437911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.437911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.440304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.441029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.441586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.441866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.443535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:08.443848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.445370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.453798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:08.455234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:08.459751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 324/631] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:08.460956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.523507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 308/632] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:08.524667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.585355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5f67-ceff-4a23-927e-dfeff94b2853 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.617959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.618760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.619042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.619315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.627017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a6464-768c-4df7-8200-173f77ea9088 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.629819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:08.638536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.639472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:08.640298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 325/633] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.640981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.665266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.666058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.666343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.666615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.673024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.674438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:08.688055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.689057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 309/634] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.694836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.735796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe9000-eb00-4052-a5c2-d0be5bce72a4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.767502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.768283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.768563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.768833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.775202 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.776644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.782648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee168eb-ded7-4065-a338-52cb3d467fcc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e9888527-4b33-42a6-9e9a-960361f6e659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:08.790182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.791179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:08.792079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 326/635] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.792950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c68-9afe-4c4f-a92a-0d4a573ded29 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.793250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c68-9afe-4c4f-a92a-0d4a573ded29 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.793528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6c68-9afe-4c4f-a92a-0d4a573ded29 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.794895 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 327/636] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:08.795491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6c68-9afe-4c4f-a92a-0d4a573ded29 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.820278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.821066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.821390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.821668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.831777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:08.839382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:08.840484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:08.841428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 310/637] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:08.842162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.898338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6c68-9afe-4c4f-a92a-0d4a573ded29 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.930656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.931254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.931538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.931814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.932552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:08.932864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.933992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10e0ed-d03e-4a59-a54e-8bc3f5e9d7c6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:08.934771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.942284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 328/638] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:08.943075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:08.967053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:08.967710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.967993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.968269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:08.969045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:08.969400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:08.970824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659bca-de34-44b8-a63f-b280154bbd25 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:08.982680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 311/639] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:08.983856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:08.984144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:08.984420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.000112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:09.001315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:09.036890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d746-7bab-4361-9b14-b4b5ce0870c1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.062883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 312/640] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:09.063696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.080639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.081327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.081609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.081883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.082664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.082966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.084401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.096271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 329/641] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.097062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.154364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7174c-cf6a-493f-b433-34b25b13f290 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.186899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.187563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.187847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.188122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.188225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd7199-7356-4484-b3b9-3c02a2757c3f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.188857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.189161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.190536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.198165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 313/642] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.198969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.224259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.225040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.225352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.225621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.235559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.236982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:09.254033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:09.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:09.256600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:09.256600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:09.256600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:09.256600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:09.257348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 330/643] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:09.258348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.291083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4bab3-092b-4317-9948-38ebd53a545d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.323047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.323695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.324009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.324286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.325104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.325443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.326857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.332429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 314/644] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.333174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.357043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fcb39-49ba-41af-9c1d-d64c047d3f41 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.393105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.394143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.394533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.395380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.406939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:09.415094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:09.416263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:09.417313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:09.420131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 331/645] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:09.421144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.444729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5a8b-fe86-425f-a14b-6cae2e29c093 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.478432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.479347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.479626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.479893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/d51afc0a8e1949fb8d3e346a97c56ef1/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.497128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=d51afc0a8e1949fb8d3e346a97c56ef1, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.499014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.514902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 315/646] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:09 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/d51afc0a8e1949fb8d3e346a97c56ef1/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:09.516105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.524944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8521654-0225-4d59-9905-c9912a173225 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.563640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.564626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.565021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.565446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.577983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.579666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:09.600441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:09.601568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:09.602639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:09.602639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:09.602639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:09.602639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:09.604371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 332/647] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:09.605928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.627070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a633-70ae-4351-b010-a64683e4f061 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.664503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.665329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.665669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.666013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.666821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.667197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.669380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.681798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 316/648] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.682777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.723241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f713a48-e999-437b-91a2-afb796947c3c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.757576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.758370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.758719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.759066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.759891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.760269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.762297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.770694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 333/649] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.771607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.789447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23d48-0733-414b-bbd1-e74291c2e256 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.823462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.824784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.825137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.825542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.826324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:09.826728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.828249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.841242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 317/650] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:09.842211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.882656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed9fed-afbd-4a79-9482-4dfbf5944833 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.917606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.918589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.918883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.919182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.927633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.929126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:09.942461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec355a-61b7-4aa6-9c5d-47455241cfe9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:09.943816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:09.945977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 334/651] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:09.948294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:09.982759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:09.983516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:09.983799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:09.984067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:09.994326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:09.995851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:10.014704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:10.015620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:10.016488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:10.016488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:10.016488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:10.016488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:10.016488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 318/652] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:10.016756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.057763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473f960-3264-4162-86ce-05b218c9a0c0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.098700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.099507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.099794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.100072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.107790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.109287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:10.123744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:10.124872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 22:06:10.125938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:10.127771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2014d-b706-4eb1-bfb5-a34ae20f7c0e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.129530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 335/653] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:10.131171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.163181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.164460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.164947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.165404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.166488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:10.166936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.168617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.191152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 319/654] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:10.192248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.232757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9ad8-987c-452e-936c-7f59c00774a0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.277468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.278741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.279194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.279900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.280905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:10.281378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.283188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.296523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f8f0d-83d8-4ca8-a4db-5fe7c4aa0740 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.299476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 336/655] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:10.300469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.346063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.346920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.347358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.347734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.349723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:10.349924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.352100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.377344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 320/656] 10.222.0.13 () {56 vars in 1137 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:10.378379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.425396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb1268-81aa-4c38-bc25-68fd4b523f4f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.468127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.468922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.469368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.469750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.498000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401f15-424c-47ad-beba-7b3d8c680169 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.536103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.538015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.539605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.545422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.546232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.546675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.555828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.557708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:10.576534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:10.577681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 22:06:10.578790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:10.581439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 321/657] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:10.582352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.668999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 337/658] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:10.668999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.706871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157c83-86c1-4da1-91f8-bdbee18b0ebc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.741827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.742717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.743161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.743645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.783417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf9ea4-6229-4344-9b49-9b520250e531 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.812888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.814745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.824156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.824842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.825115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.825437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:10.826278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:10.826796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:10.828079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:10.852086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 338/659] 10.222.0.13 () {56 vars in 1139 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:10.853013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.913468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 322/660] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:10.914628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:10.952562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8749b5-d989-4c01-aa4c-6a6c6e006c89 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:10.993700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:10.994499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:10.994782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:10.995056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.006885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.008388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.017600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145900c-5b11-481f-9525-29d2f189be26 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:11.025792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.026799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.028208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:11.028208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:11.028208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.028208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:11.033021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 339/661] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.033890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.055257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.056118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.056540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.056957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.123479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.125161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.133941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9df8-bdc7-41ae-bd22-5859e24b3b4a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.168101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.168897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.169263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.169547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.180006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.181566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:11.200959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.202018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.203014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:11.203014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:11.203014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.203014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:11.203014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 340/662] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.207548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.227130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 323/663] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:11.228092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.304061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83425b7-044c-4245-b6db-dadb890ef5fc None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.329889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4b25f-fd48-4964-863b-ce4dec096dbe None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.338559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.339230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.339664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.339941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.340668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:11.340979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.342427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.354199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 341/664] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:11.359614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.364188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.364956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.365268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.365546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.366256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:11.366558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.367911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.380156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 324/665] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:11.381338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.461130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329280ed-80e1-4d2b-867f-e3294e133799 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.478113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b735c-1e4f-4415-99ec-1c6db0b26e0c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.494964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.496289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.496582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.496855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.508136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.509624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.513749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.514545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.514824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.515093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.521820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.523240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:11.526853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.528813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 342/666] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.530933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:11.537660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.539630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 325/667] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.541702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.637981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c691b-b186-4376-8ece-4bdb73c24902 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.641095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307652a-48af-4764-82ea-eb7196091d48 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.676414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.677263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.677556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.677834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.679652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.680319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.680601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.680873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.681618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:11.681921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.683326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.685169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.686659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.695387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 326/668] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:11.696333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:11.701507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.703450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 343/669] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.705440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.795485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174860f-a45b-4851-a93b-94dd7054c835 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.812542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0593f-77a7-4206-af34-7ceee058571c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.828024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.828687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.828970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.829268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.830047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:11.830354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.831793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.844914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 327/670] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:11.845828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.852557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.853389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.854083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.854366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.861530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.862982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b3dffa32-c8fe-446a-84c1-c96c1225a147 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:11.876889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:11.878808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 344/671] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6696f-9bc4-4225-b097-dfbe3bb49386 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.879867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6696f-9bc4-4225-b097-dfbe3bb49386 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.881125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6696f-9bc4-4225-b097-dfbe3bb49386 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 345/672] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e164d-4e36-44ae-827f-2592d243a01d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e164d-4e36-44ae-827f-2592d243a01d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e164d-4e36-44ae-827f-2592d243a01d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 346/673] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:11.885599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e164d-4e36-44ae-827f-2592d243a01d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:11.941430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32686ba6-6608-4338-8bd7-267ba4c26f1f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.972976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:11.973669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:11.973947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:11.974217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:11.974983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:11.975287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:11.976705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:11.982687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e164d-4e36-44ae-827f-2592d243a01d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:11.988089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 328/674] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:11.988876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.014676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.015317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.015594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.015866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.016677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=4e8bbada4fbb48a186e373ac378e1fda) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.016983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.018432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67580dc9-c7ab-4069-adef-716fb09738d1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.023894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 347/675] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/role_assignments?user.id=4e8bbada4fbb48a186e373ac378e1fda&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.025033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885668f-e147-4700-8204-195ddd975814 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.025419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885668f-e147-4700-8204-195ddd975814 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.025697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885668f-e147-4700-8204-195ddd975814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.043205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9885668f-e147-4700-8204-195ddd975814 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:12.044445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9885668f-e147-4700-8204-195ddd975814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:12.092590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222282-d7ae-4a64-81fc-219721fc7c2d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.121403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 348/676] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:12.121403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.121403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.121403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.139144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:12.139625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.140468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.140662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:12.141078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.141566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.142395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.142951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.144412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.157007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 329/677] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.157997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.217638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 349/678] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:12.219180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.269777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135815e-ffa4-4a8d-8fc0-cba11d0ea075 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.307678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.308968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.309290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.309567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.310390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=fa8d29f2955b4edaa93ecdd798ea4f62) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.310701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.312110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.321357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 330/679] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/role_assignments?user.id=fa8d29f2955b4edaa93ecdd798ea4f62&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.322421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.328874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf5368-6bea-455b-b313-52d7a0e6106c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.369691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.371038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.371521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.372001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.384881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:12.393237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:12.394335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:12.395150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:12.398029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 350/680] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:12.399158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.448725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea574d1-fa79-4bfa-bfaa-9dbc915f5470 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.486092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.486633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.486918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.487191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.488046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=86b0cbde93e04bc2832ec379ccc001c8) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.488351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.489871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.505303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 331/681] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/role_assignments?user.id=86b0cbde93e04bc2832ec379ccc001c8&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.506604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.511304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa5263-2275-4899-8b9b-0631b586ff76 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.558305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.559474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.560697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.561081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.575702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:12.586422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:12.587600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:12.588568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:12.591865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 351/682] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:12.597500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.644208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823111d6-b138-405c-b9e6-f2cfed9a72d6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.692489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.693389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.693771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.694139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.695628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.696061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.697861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.712522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 332/683] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.718866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.731076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1b0cf-2d1a-4614-a1d8-8c2fd43fdd3a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.775114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.776012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.776296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.776572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.778056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:12.778741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.780136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.790806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 352/684] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:12.796982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.846848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a0fdc-0d37-4cb9-9f3e-b027689f26d6 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.889319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.890632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.891039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.891317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.905634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.907340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:12.908025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1133-bfa4-4360-9936-e3caa44e7233 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:12.926478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:12.927584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:12.928626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:12.928626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:12.928626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:12.928626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:12.928626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 333/685] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:12.936157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:12.951801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:12.952679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:12.952964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:12.953324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:12.972870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:12.974368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:13.005474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:13.007126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:13.008173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:13.008173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:13.008173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:13.008173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:13.008173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 353/686] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:13.012759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.041532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb07b-624c-4ecf-9c97-272603792ac3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.101236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.101236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.101236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.101236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.101657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:13.101657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.103014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.123698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 334/687] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:13.130340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.203209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1de595-0a8f-42ec-92f2-6b93c1d56b41 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.263021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.264132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.264620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.265081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.266487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:13.267411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.270523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.278740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce710a0-41ca-47d5-b9e1-d6d8dccf6c18 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.296104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 354/688] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:13.301003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.378882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.379689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.379969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.380239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.398328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.399764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.402723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a72db-50f9-4eaa-bffd-d39fec99bf46 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:13.425394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:13.426358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:13.427260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 335/689] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:13.432118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.437648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.438449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.438733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.439009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.446510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.448026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:13.463948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:13.464940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:13.465875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:13.469554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 355/690] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:13.471190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.577991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a397a9-377a-4980-89ac-5dd190db48ff None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.615047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.615724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.616007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.616285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.617125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:13.617461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.619623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.639581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 356/691] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:13.645004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.716805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72734875-46ba-4916-b56a-f7ab76b2846f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.753417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eb627-4e14-4051-876b-a0ef21b2020c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:13.791038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.791693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.791974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.792250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.813974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:13.814670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:13.814957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:13.815237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:13.816080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:13.816390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.817862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:13.854074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 336/692] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:13.859839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:13.866064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:13.868353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.018331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 357/693] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:14.026192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.035666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bbc71-9e0d-4948-b50b-cce624cf407b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.071805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.072924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.073415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.073933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.179512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.180880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.218720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804d3d-9407-4746-af37-8c7508f61d64 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.273180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.273996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.274275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.274549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.294487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.295939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:14.328390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:14.329346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:14.330232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:14.330232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:14.330232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:14.330232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:14.339427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 358/694] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:14.340294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.350996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 337/695] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:14.358513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.454333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab835ea2-c073-4171-b1bd-3b68b1ef2c08 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.489344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.490370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.490882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.491357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.492279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:14.492787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.494403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.507361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 359/696] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:14.512452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.562683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ebbd-1c75-445f-a529-3007840c8175 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.625105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.625934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.626220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.626494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.639099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.640547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-013af6af-59c6-4d98-a710-020e18bb1940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:14.658438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:14.659365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:14.660841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:14.660841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:14.660841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:14.660841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:14.660841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 338/697] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:14.661262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc184e00-086a-4724-b5b6-b2f412fe7691 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.661519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc184e00-086a-4724-b5b6-b2f412fe7691 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.661800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc184e00-086a-4724-b5b6-b2f412fe7691 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.662296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bab1e-5788-4db0-ba88-4229538bf6a5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.667291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 339/698] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:14.668643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc184e00-086a-4724-b5b6-b2f412fe7691 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.698013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.699226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.699713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.700194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.707340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.709048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-7d697311-4bbd-42ae-9c7e-16328e541f92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:14.724178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:14.725052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:14.725987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:14.728484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 360/699] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:14.730546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.731038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.731523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.758645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:14.760505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:14.781054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc184e00-086a-4724-b5b6-b2f412fe7691 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.825992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:14.826994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:14.827562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:14.828450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:14.829689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:14.830200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:14.832462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:14.849893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 340/700] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:14.851182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.853341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 361/701] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:14.857460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:14.968861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c61c5-b0dd-4220-9e0f-acb9bb8bfa90 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:14.986250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5fb7-df29-4a44-88ea-4b54dbc94e2b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.007530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.008571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.009055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.009562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.010538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.011059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.013248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.026371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 341/702] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.028211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.032127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.033371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.033706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.033986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.047014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.049353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:15.063206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:15.064092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:15.065176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 362/703] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:15.066180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.134093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d266d2-aea6-4fa2-98f9-82f3e1cc89bf None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.166819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350ca77-cee9-437e-ab0a-c62fe7190cf4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.168050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.168852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.169129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.169429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.170096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.171469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-aeae38ff-13ee-45ee-b85f-d15af6cc900d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:15.185043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:15.186224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.187038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 342/704] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:15.187857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934ddc-c574-4861-9bdd-c65b5c2b6c1e None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.187857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934ddc-c574-4861-9bdd-c65b5c2b6c1e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.187983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934ddc-c574-4861-9bdd-c65b5c2b6c1e None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.193365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 343/705] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:15.194147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934ddc-c574-4861-9bdd-c65b5c2b6c1e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.206722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.207568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.208027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.208447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.209489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=d51afc0a8e1949fb8d3e346a97c56ef1) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.209801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.211231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.225752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 363/706] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/role_assignments?user.id=d51afc0a8e1949fb8d3e346a97c56ef1&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.227071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.327837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934ddc-c574-4861-9bdd-c65b5c2b6c1e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.344441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa655-f080-487e-bf22-b07c0ca1829e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.363665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.364404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.364613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.364887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.365705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.366015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.367453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ae1ae-3ec4-4a84-ab1d-10d4a6fa24d3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.380016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 344/707] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.380503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.381657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.381798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.381962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.382236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.382645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.383083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.384142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.384457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.386085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25d727-7611-4460-a057-0acda11fa3b6 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.391154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 364/708] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.392484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d0f4-1209-4297-9406-fd76f6c5658e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.392771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d0f4-1209-4297-9406-fd76f6c5658e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.393036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5d0f4-1209-4297-9406-fd76f6c5658e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.398234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 365/709] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:15.398234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d0f4-1209-4297-9406-fd76f6c5658e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.405846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:15.407173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:15.486750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 345/710] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:15.487602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.518128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5d0f4-1209-4297-9406-fd76f6c5658e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.557883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.558937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.559346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.559756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.560940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.561278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.562854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69e59-7f87-4b63-831e-fb7929838f77 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.577453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 366/711] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.577453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.577453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.577453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.587507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:15.588733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:15.611820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb21ef9-ae7e-40fc-aebf-86fd215491df None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.666010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.666705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.667199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.667571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.669231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:15.669871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.671282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.674343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 367/712] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:15.675309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.685319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 346/713] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:15.709683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:15.812696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff54b01-a0c4-42b2-a708-09aa32af9cd2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.899635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495414d-c87c-4957-a49d-3cad7f845d2c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:15.939201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:15.940174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:15.940560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:15.940938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:15.941748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:15.943280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:15.957271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:15.958525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:15.959460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:15.960694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 347/714] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:15.969336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:16.030847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:16.031671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:16.031970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:16.032692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:16.045937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:16.047939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:16.070757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:16.071673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:16.072552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:16.072552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:16.072552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:16.072552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:16.072552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 368/715] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:16.079424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:16.105461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b9f7e-5868-44af-9ab9-d895f5d884b7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:16.167075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:16.168174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:16.168458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:16.168736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:16.169463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] RBAC: Adding query filter params (name=network) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:16.169769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:16.171131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:16.180020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 348/716] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:16.187491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:16.251582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f459d-d03c-4a7e-be88-eb3e6a6072c7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:16.296154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:16.297268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:16.297853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:16.298353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:16.299271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:16.299792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:16.301378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:16.313605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 369/717] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:16.316139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e87f-cc54-4f8b-b2cf-7d30a6466b6d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:16.319328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:16.358637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:16.359210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:16.359498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:16.359861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:16.361026 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] RBAC: Adding query filter params (type=network) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:16.361372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:16.362814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8cd5f-083a-496f-8cd4-37136cb1bf91 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:16.369422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 349/718] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:16.428878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e9d6-2506-48fa-bd84-54a4f6661324 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:16.464931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:16.465913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:16.466347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:16.466793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:16.467685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:16.469416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6eb33-0165-4ef7-bd5f-3cb65c18e96d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:16.492566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 370/719] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:06:16 2022] POST /identity/v3/users => generated 254 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:17.968384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d548-5330-42fc-839c-710f25ca9b8b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:17.969482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d548-5330-42fc-839c-710f25ca9b8b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:17.969975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208d548-5330-42fc-839c-710f25ca9b8b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:17.971779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 350/720] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:17.977331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:17.978158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:17.978651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.000372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:18.002264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:18.078982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 371/721] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:18.103255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d548-5330-42fc-839c-710f25ca9b8b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.211476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208d548-5330-42fc-839c-710f25ca9b8b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:18.245388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:18.246540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.247023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.247492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.258093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8de33fb6-2a5a-4a8f-812c-adc92220ad18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:18.266744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:18.267744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:18.268593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:18.271426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 351/722] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:18.278055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.367663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd93b-40d8-4203-b557-462af53b8fa2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.368262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd93b-40d8-4203-b557-462af53b8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.368740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd93b-40d8-4203-b557-462af53b8fa2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.371042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 352/723] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:18.376348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcbc0c-65ba-4f7c-94ff-4d9b223e5f68 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.376637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcbc0c-65ba-4f7c-94ff-4d9b223e5f68 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.376918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcbc0c-65ba-4f7c-94ff-4d9b223e5f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.401644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2433af-b60e-4b59-9086-123cfa69a450 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:18.414262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-85dcbc0c-65ba-4f7c-94ff-4d9b223e5f68 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:18.415438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-85dcbc0c-65ba-4f7c-94ff-4d9b223e5f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:18.439944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:18.441113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.441627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.442104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.443059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:18.443596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:18.445180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:18.456424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 372/724] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:18.462867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.573573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68ee1d-3c23-4b71-8885-f204e3b4de5e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:18.581228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 353/725] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:18.581228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38277d-9b22-439e-8ca2-106542f65bed None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.581228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38277d-9b22-439e-8ca2-106542f65bed None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.581228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38277d-9b22-439e-8ca2-106542f65bed None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.581228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 354/726] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:18.585883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.586172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.586450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.604921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:18.606346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:18.631966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:18.633094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.633623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.634098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.645343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:18.647122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:18.667389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:18.668316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:18.669178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:18.669178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:18.669178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:18.669178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:18.671486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 373/727] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:18.676859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.680594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 355/728] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:18.687648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.804019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40005-1761-4f86-97dd-42e13eba9326 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:18.811246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aac1b-9d0b-418d-8bdd-76df122ddd4b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:18.845759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:18.846907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.847442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.847941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.848957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:18.849506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:18.851122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:18.851550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:18.852370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:18.852656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:18.852931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:18.869289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:18.870012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 356/729] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:18.871265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:18.876697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:18.877942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:18.878803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 374/730] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:18.879471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:18.992272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee75e-ef24-49e1-bd8c-fd25127c9712 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.000852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baace1c1-0597-4939-9ad0-5570da6badc5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.029596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.030746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.031249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.031720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.041362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.043123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.043400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.044077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.044362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.044644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.045391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.046747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fa6c3-a501-47c3-a527-c2c0472d7b5d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:19.059672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:19.060674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:19.061614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 375/731] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:19.062197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.069492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 357/732] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:18 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:19.070979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4245-b46f-4851-aafc-a767df2dd232 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.071414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4245-b46f-4851-aafc-a767df2dd232 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.071922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4245-b46f-4851-aafc-a767df2dd232 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.078157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 358/733] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:19.079312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4245-b46f-4851-aafc-a767df2dd232 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.192270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e76d67-a5ea-41ac-8a1f-5b02f2a9ffdf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.227998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4245-b46f-4851-aafc-a767df2dd232 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.235455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.236425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.236858 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.237311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.238777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:19.239272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.241252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4368bd-064c-4830-90fe-438ee674f5ce None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.253019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 376/734] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:19.255395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.256089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.256519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.272359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.273047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.273429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.273706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.274976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:19.274976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.276332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.282055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:19.283489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:19.300213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 359/735] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:19.301381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.363411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 377/736] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 22:06:19.364284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.424704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927884-4c23-4839-bafd-c34621ba47d8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.463113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59577-bf04-47a4-a667-420fea9c8b5d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.473359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.474823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.475230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.475514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.487991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.489750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.497856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.498727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.499213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.499683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:19.507773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:19.508620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:19.509730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:19.509730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:19.509730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:19.509730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:19.513516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 360/737] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:19.514461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.567919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.569407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.612351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89dc30-1852-4114-8fb3-ca48d16a512d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.648346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.649019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.649336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.649620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.650347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.651797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a2187-4da5-4060-adf4-820bf1b0d594 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.666220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 361/738] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:19 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:19.667666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a5a-e64f-426a-8992-c13fcee08fe7 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.667957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a5a-e64f-426a-8992-c13fcee08fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.668234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053a5a-e64f-426a-8992-c13fcee08fe7 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.673246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 362/739] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:19.673246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053a5a-e64f-426a-8992-c13fcee08fe7 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.674284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 378/740] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 22:06:19.675294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:19.799702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753056b0-ec02-4b25-ba8d-110bd5df64da None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.849409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.850234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.850520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.850797 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.863243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.864825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a49e5919-fee7-4e78-ae8f-1b6c95567237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:19.888147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:19.889083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:19.890011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:19.890011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:19.890011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:19.890011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:19.890011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 379/741] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:19.891098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.891384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.891660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.914777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:19.915999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:19.942575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053a5a-e64f-426a-8992-c13fcee08fe7 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:19.987954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:19.988936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:19.989235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:19.989523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:19.990520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:19.990828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:19.992183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:19.994577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 380/742] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:19.996170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.005371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 363/743] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.012470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.097440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927be75-d1be-417b-869f-2d669c3e6ae3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.118884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958ce2-fa4e-4105-ae43-513a256a5f7a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.132127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.132788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.133071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.133427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.134161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:20.134469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.135847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.147602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 381/744] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.148442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.165479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd19-f259-4383-b696-af17b809091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.166609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd19-f259-4383-b696-af17b809091e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.167181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd19-f259-4383-b696-af17b809091e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.168272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bd19-f259-4383-b696-af17b809091e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.176325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bd19-f259-4383-b696-af17b809091e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.177993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bd19-f259-4383-b696-af17b809091e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-1476bd19-f259-4383-b696-af17b809091e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:20.192216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:20.193180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:20.194165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:20.201340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 364/745] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:20.202428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd19-f259-4383-b696-af17b809091e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.247489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598db466-f6d8-4270-b9d4-ea59f33d2bc4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.298104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.299200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.299487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.299766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.312916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:20.313219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bd19-f259-4383-b696-af17b809091e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:20.322481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:20.323411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:20.324770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:20.325418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 382/746] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:20.327199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.354092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.354969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.355257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.355582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.362999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.364487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:20.378714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:20.380996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 365/747] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:20.383159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.453750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c71e6-3acc-498e-b5a3-abd55778d897 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.484636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79656a9-7f4b-437f-af7b-a398f9ea720f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.496786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.497531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.497986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.498268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.499640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:20.500082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.502022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.522751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 383/748] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.523823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.532533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.534007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.534007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.534007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.536395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:20.536395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.536682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.548050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 366/749] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.549237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.637872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198f5d7-5793-42be-8861-8e3d3f9a22e4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.665244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8402d-b82d-47a2-9a15-25d8eccfd6ca None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.679627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.680629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.680984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.681360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.682378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:20.682781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.685140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.700417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 384/750] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.701411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.701979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.703014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.703507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.703964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.715871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.717670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:20.734669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:20.735557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:20.736434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:20.736434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:20.736434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:20.736434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:20.743223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 367/751] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:20.744306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.818767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa352990-a605-4c67-aa40-5f908dd7d7f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.859052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.860247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.860737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.861232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.864548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff91f-883b-4941-a7d2-9cc5d8be8f9e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:20.872809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.874691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:20.893010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:20.893991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:20.894859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:20.894859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:20.894859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:20.894859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:20.897283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 385/752] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:20.898619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:20.908928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:20.910284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:20.910582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:20.910952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:20.911697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=d51afc0a8e1949fb8d3e346a97c56ef1) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:20.912016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:20.914018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:20.921710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 368/753] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/role_assignments?user.id=d51afc0a8e1949fb8d3e346a97c56ef1&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:20.922912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.017233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28709e-bd04-4272-bba0-40e0000b8482 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.062622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.063360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.063647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.063931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.064668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:21.064978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.073234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.080396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 386/754] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:21.085828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.113099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23667-3a93-4b72-a9e9-7ed701fbcbd3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.187770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.187770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.188034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.188116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.188835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:21.189141 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.191028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.203751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 369/755] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:21.209011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.262392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035be5-7af4-4160-86ee-3dc61bdf716c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.309576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80356-a267-40f1-8f19-f8f63a695f63 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.319307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.320443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.320934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.321441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.332509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.334503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.344581 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.345437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.345719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.346006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.365502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.366975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:21.369240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:21.370116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:21.371054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:21.377237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 387/756] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:21.392324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:21.397329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:21.398257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:21.399171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:21.403796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 370/757] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:21.410592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.565273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf6d1-bbde-4e29-9b26-0e4c4dd52024 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.572220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a967a-339d-4c6c-8a85-71669a7a2ceb None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.608901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.609601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.609886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.610165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.610368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.610962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:21.611270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.611528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.611945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.612351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.612715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef248d-f99b-46b0-9cfb-bdba370211d5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.613516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:21.613961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.616149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ff6-0701-480c-b801-fb24aa25963d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.625839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 388/758] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:21.627424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcb85-7408-44d0-85a7-2245ac7c3933 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.627718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcb85-7408-44d0-85a7-2245ac7c3933 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.627996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcb85-7408-44d0-85a7-2245ac7c3933 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.638766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 389/759] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:21.638766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcb85-7408-44d0-85a7-2245ac7c3933 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.644781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 371/760] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:21.646410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.646842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.647258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.668970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:21.670418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:21.745353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 372/761] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:21.746539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.769635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcb85-7408-44d0-85a7-2245ac7c3933 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.808355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.809448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.809830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.810309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:21.812393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=dd2eb7a2de50414587c7bd815d401959, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:21.814040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:21.832647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 390/762] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:21 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:21.834071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:21.908947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fe9fc-39a7-4156-b6dd-78d1e935ee46 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:21.974310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:21.975251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:21.975696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:21.976108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.048682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e7aa0-7c39-411e-9252-66dd2579acea None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.073961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.075517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196e2cc-05ba-4f2e-85e9-b94fba0c2682 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.094685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.095501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.095849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.096189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.096908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.098494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d55d3fa5-3ade-4ab8-ba9b-6f09c53cbef4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:22.112142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:22.113406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:22.114235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 391/763] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:22.115071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96eaf-e474-4c3f-80ff-8a2926d23fa4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.115254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96eaf-e474-4c3f-80ff-8a2926d23fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.116312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96eaf-e474-4c3f-80ff-8a2926d23fa4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.117172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 392/764] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:22.122220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96eaf-e474-4c3f-80ff-8a2926d23fa4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.210074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 373/765] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:22.212364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.212800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.213271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.227299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96eaf-e474-4c3f-80ff-8a2926d23fa4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.233969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:22.235779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:22.263421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.264658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.265318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.265716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.266570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:22.267087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.268443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.273611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 393/766] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.274442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.320866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 374/767] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:22.322043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.406798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5a23-9b72-495e-b20d-913848be2943 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.427777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bad04-1911-4081-bdf4-d9ac154a5c1f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.451304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.452035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.452416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.452866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.464022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.465675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.467742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.468885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.469370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.469805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.470663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:22.471116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.472603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.478977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 375/768] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.480462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:22.485050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:22.486140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:22.487233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:22.487233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:22.487233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:22.487233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:22.488811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 394/769] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:22.489839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.588569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dad84d-7683-4fef-be8d-dd1e8eeb0634 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.597011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7eea-cfb8-4f5a-beba-d031fc5c8b6b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.622640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.623265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.623544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.623818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.624600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] RBAC: Adding query filter params (interface=public, service_id=af3a5fe1ff1040a4ab2dd11e19085463, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:22.624912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.626307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.633971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.634498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 395/770] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/endpoints?service_id=af3a5fe1ff1040a4ab2dd11e19085463&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.635281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.635459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.636084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.636558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] PATH_INFO: `/v3/services/network` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.637429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.639219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:22.651119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:22.652121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:22.652960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:22.655794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 376/771] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:22.656769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.740794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b1af-151f-4d66-a646-ce873cbf71f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.756392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2e355-8fe6-43f9-ada6-a62d33d7eab9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.775402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.776067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.776354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.776659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.777475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:22.778125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.779197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.791328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 396/772] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.792816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.793040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.793947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.794429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.794899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.796010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.797624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.803799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 377/773] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services => generated 772 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.804819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.898092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45ba1a-b05d-4b3c-b5e7-001f5c7c4787 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.909382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364cff0-373f-4e0d-acc5-090d49d017c0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:22.935379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.936062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.936340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.936696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.937361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] RBAC: Adding query filter params (name=network) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:22.937666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.939153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.947737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:22.948837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 397/774] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:22.949148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:22.949655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:22.950135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:22.950239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:22.957887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:22.959742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:22.975435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:22.976362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:22.977242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:22.980296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 378/775] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:22.990261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:23.056718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e46b5e-6715-44e5-882a-a0ef7b9aab79 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.093115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.093810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.094090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.094360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.095293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] RBAC: Adding query filter params (type=network) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:23.095411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:23.096831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:23.098672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b4ba3-3d15-4726-aeb4-5d4d93f85846 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.107161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 398/776] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:23.109637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:23.134361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.135392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.135887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.136423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.137439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:23.137951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:23.139596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:23.152309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 379/777] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:23.157789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:23.215713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6be8-a511-48a0-818b-ae27a9567990 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.249903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.250586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.251084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.251363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.252730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] RBAC: Adding query filter params (interface=public, service_id=88e323f6194541ad84e4819532fecf0e, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:23.253050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:23.254526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:23.263184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 399/778] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:23 2022] GET /identity/v3/endpoints?service_id=88e323f6194541ad84e4819532fecf0e&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:23.268220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:23.276100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb46c0d-a18b-451b-ac0b-d8c82000ecdf None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.316258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.317859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.318147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.318425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.322452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=a459163f5d714b3f92b6e90e75deb308) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:23.322804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:23.327710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a1db-8541-4a21-8d85-2bf77dc7e373 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:23.341254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 380/779] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:23 2022] GET /identity/v3/role_assignments?user.id=a459163f5d714b3f92b6e90e75deb308&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:23.410821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09eb85-d473-4096-b85b-b35234a58521 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.453103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.453814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.454102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.454383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.455088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:23.456473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c0a68-0858-4570-a1ae-c7657c563ef5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:23.462677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 400/780] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:23 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:23.583614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ab1-dfbe-4f06-be5f-46b474c4e6a2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.583912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ab1-dfbe-4f06-be5f-46b474c4e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.584098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ab1-dfbe-4f06-be5f-46b474c4e6a2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.585780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 381/781] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:23.592208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.592876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.593400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.616663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:23.618273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:23.715228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 401/782] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:23.766713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58ab1-dfbe-4f06-be5f-46b474c4e6a2 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:23.902758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58ab1-dfbe-4f06-be5f-46b474c4e6a2 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:23.941345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:23.942148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:23.942431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:23.942705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:23.954266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:23.961933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:23.962871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:23.963701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 382/783] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:23.971883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.111634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf711-ad5c-4339-89a7-1b581dbe2df9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.161790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.162384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.162669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.162942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.163696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:24.164005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:24.165408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:24.176607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 402/784] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:24.182216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.324748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76233e-e075-42f1-823d-b9c4b58d04b1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.372385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.373187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.373497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.373773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.384848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:24.386366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-6d3b41b1-5690-448b-8391-f4257d823423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:24.410756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:24.412897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:24.415116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:24.415116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:24.415116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:24.415116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:24.415116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 383/785] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:24.418462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.452304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2004-a3fa-45c4-b3e3-81e9113aaaf9 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.452629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2004-a3fa-45c4-b3e3-81e9113aaaf9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.453032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2004-a3fa-45c4-b3e3-81e9113aaaf9 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.454738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 384/786] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:24.459845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.460608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.460890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.498234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:24.499446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:24.538836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58331a7-536b-4e47-a2ee-2f1a888b4e08 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.572866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.573700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.573987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.574266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.574993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:24.575303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:24.576694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:24.589611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 403/787] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:24.595662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.615610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 385/788] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:24.639568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.707653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184fc4a-714c-4c49-9b15-1f0c9ae3527c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.743052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.743902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.744191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.744470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.751802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:24.753267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:24.768629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:24.769681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:24.770582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 404/789] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:24.775789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.867345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f908f-ab53-49e4-a355-ae0f64b89fda None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.877728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3fdde-fb9c-43f9-ad69-469167be3c61 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:24.911889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.912475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.912773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.913084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.919111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:24.919424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:24.920876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:24.924571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:24.925405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:24.925691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:24.925968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:24.947661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:24.960515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 405/790] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:24.960943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:24.962111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:24.962923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 386/791] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:24.968051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:24.969265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.084248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2a463-7cbd-4822-8610-9e7cf801044b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.122010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.122819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.123164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.123441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.140908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.145879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.166715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565ad59-1b24-438c-a4d2-16986b4e9f9e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:25.176221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:25.177086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:25.177997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:25.177997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:25.177997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:25.177997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:25.177997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 406/792] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:25.183914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.230494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.231388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.231810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.232241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.233132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:25.233595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.235079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.249653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 387/793] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:25.255515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.359448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26f9d-53f7-4588-8408-53781db0e158 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.376859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c562a-ff19-4501-b98e-7a0dcdd25109 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.393867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.394657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.394937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.395208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.405797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.407235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:25.423843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:25.424841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:25.425874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:25.425874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:25.425874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:25.425874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:25.425874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 388/794] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:25.432495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.460162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.460896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.461186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.461490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.462485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:25.462803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.464284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.499645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 407/795] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:25.510187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.532782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425b39-67a2-496c-91f0-4b9c9206cd30 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.566841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.567512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.567795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.568066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.568790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:25.569090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.570523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.584098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 389/796] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:25.590104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.698759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bad1d-dc44-41e9-aa0e-b845d2c219a9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.721331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339825a0-23ee-4427-a357-85babf95d84b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.741294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.742090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.742370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.742640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.750622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.751976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:25.766548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:25.767485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:25.768482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 390/797] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:25.773619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.801186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.804836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.804836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.804836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.818474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.819970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9f12d7a3-570c-455c-88fe-c4e5c5f10139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:25.848174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:25.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:25.849985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:25.853481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 408/798] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:25.855532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bc5-941a-4157-9c7c-5ce2de225365 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.856044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bc5-941a-4157-9c7c-5ce2de225365 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.856531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1bc5-941a-4157-9c7c-5ce2de225365 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.858329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 409/799] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:25.863183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1bc5-941a-4157-9c7c-5ce2de225365 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:25.900044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d275f-2551-4138-a9f5-322ed9a2ca6e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.933559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:25.934235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.934514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.934788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.935608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:25.935912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:25.937354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29400d-1841-4b3b-ba4b-9ca5975bad3d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:25.955600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 391/800] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:25.956948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:25.957251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:25.957524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:25.970708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1bc5-941a-4157-9c7c-5ce2de225365 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:25.976258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:25.977475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:26.007216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.008290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.008898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.009503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.010738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:26.011839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.013566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.026461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 410/801] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:26.027820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.046537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 392/802] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:26.053464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.136456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed193cd-b009-424d-b1f1-d61514a462a9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.152790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84796ea-c3dc-4328-b7d4-75ee3cad1389 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.171290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.172007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.172297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.172574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.187557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.188438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.188723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.188993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/d51afc0a8e1949fb8d3e346a97c56ef1/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.190964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=d51afc0a8e1949fb8d3e346a97c56ef1, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.192384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26f2a3-d5f2-4703-b897-e860c2513489 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.217318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 393/803] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:26 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/d51afc0a8e1949fb8d3e346a97c56ef1/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:26.218961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03cf92-b2c5-4aeb-bf8a-af1e06aed0c1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.219244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03cf92-b2c5-4aeb-bf8a-af1e06aed0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.219543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03cf92-b2c5-4aeb-bf8a-af1e06aed0c1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.221176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 394/804] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:26.221828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03cf92-b2c5-4aeb-bf8a-af1e06aed0c1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.261185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.263342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d869b-698f-4005-be1a-d349220956f5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.368430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03cf92-b2c5-4aeb-bf8a-af1e06aed0c1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.381150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 411/805] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:26.382743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4904-8234-4cc5-92a3-f3aeaa1f1f49 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.383244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4904-8234-4cc5-92a3-f3aeaa1f1f49 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.383909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4904-8234-4cc5-92a3-f3aeaa1f1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.401373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-871d4904-8234-4cc5-92a3-f3aeaa1f1f49 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:26.403010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-871d4904-8234-4cc5-92a3-f3aeaa1f1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:26.412622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.413466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.413745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.414009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.415888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.416065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:26.428797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:26.429900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 22:06:26.430708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:26.432160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 395/806] 10.222.0.13 () {56 vars in 1129 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:26.433472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.484601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 412/807] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:26.486113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd37-9bdb-43bd-b7ef-3e77c95d5790 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.486404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd37-9bdb-43bd-b7ef-3e77c95d5790 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.486680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bbd37-9bdb-43bd-b7ef-3e77c95d5790 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.488364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 413/808] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:26.488888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bbd37-9bdb-43bd-b7ef-3e77c95d5790 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.537842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e21b-d376-44fb-87c7-0301189609e7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.572341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.573127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.573473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.573742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.583894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.585346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.593235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bbd37-9bdb-43bd-b7ef-3e77c95d5790 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-91468649-d6a5-4852-888d-d4110eac9956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:26.602553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:26.603444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:26.604407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:26.604407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:26.604407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:26.604407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:26.604407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 396/809] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:26.605848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.605848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.606062 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.622181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:26.623348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:26.631403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.632074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.632363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.632648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.633403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:26.633716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.635086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.639563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 414/810] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:26.640351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.703766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 397/811] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:26.704623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.753134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ab3-5358-43f0-9e59-c27a8ea0632f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.787645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.788510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.788741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.789018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.799517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:26.807216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:26.808340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 415/812] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:26.809498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.810525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dbf68-c16a-4253-85f7-f776817c67e1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.846324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.846996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.847278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.847550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.848262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:26.848564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.849947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.865501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 398/813] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:26.865501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.913521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a587779-4efc-4583-ae8c-c1e103127c4c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:26.949430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:26.950088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:26.950366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:26.950639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:26.951333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:26.951640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:26.953003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:26.957678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 416/814] 10.222.0.13 () {56 vars in 1124 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:26.958456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:26.968473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db289-864b-44ca-95f1-210daa461d99 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.000848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.001677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.001957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.002232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] PATH_INFO: `/v3/services/network` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.002879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.004233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:27.016344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:27.017354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 22:06:27.018185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:27.022518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 399/815] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:27.023341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.057467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943764-c8e9-4f60-9b30-3b1f484acabf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.090622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.091300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.091587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.091864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.092612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.092919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.094325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.102362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 417/816] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.102999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.125389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ee597-fd02-4cc1-9aae-f6548bb91dda None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.157147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.158280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.158767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.159261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.165887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.168054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:27.181913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:27.183355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:27.184220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:27.188533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 400/817] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:27.189159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.205189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadba67-6180-4c34-affe-4c9df3b9484c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.245902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.247038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.247342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.247879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.248612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.250164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.281276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 418/818] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:27.281276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.295435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1577-eb87-4b29-96e7-0ff734bd7aa0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.336922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.337664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.338009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.338348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.339751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.340143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.341631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.351580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 401/819] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.352777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.387182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e259ce-a017-449e-963c-de6efc0f79ed None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.422701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.423624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.423979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.424325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.436200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.441233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:27.459897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:27.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:27.462179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:27.462179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:27.462179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:27.462179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:27.468217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 419/820] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:27.469380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.473712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce383d-b35c-4002-b8e0-0018a0430fd2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.518766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.519679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.519966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.520238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.521146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.521439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.522931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.536562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 402/821] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.536562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.590636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a480ee-cfd2-4620-89a2-9406e373f646 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.633313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.634149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.634440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.634720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.635779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.636658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.638507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.644865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c03554-cf71-4272-82d9-f0ccb9826ef3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.649367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 420/822] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.649367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.685089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.686155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.686696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.687174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.688089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.688619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.690546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.709846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 403/823] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.711106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.753888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbda83-d703-436c-bcd5-de67f75464e9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.790028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.790688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.790974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.791252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.792599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:27.792914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.794368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.800522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 421/824] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:27.808907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:27.815764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75194b-d29d-4875-8b94-14fd1ac0f6f9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:27.860553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:27.861670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:27.862383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:27.863407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:27.865421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:27.868702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:27.913995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 404/825] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:27.984811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e854e8-d079-4447-8461-e2bc88cab6e3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.043350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.045319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.046211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.047132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.060552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.062681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:28.087203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:28.088225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:28.089724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:28.096933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 422/826] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:28.098777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.211003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4798d-d613-40d4-9827-3fe1bd516bd2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.245848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.246770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.247048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.247319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.248148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:28.248449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.249895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:28.270981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 405/827] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:28.276292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.383280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a420f3-0aee-4bad-af42-787278ec0204 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.418733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.419534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.419814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.420083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.430531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.431970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-30dc75b4-39b5-4f12-acc5-142b2ca7683a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:28.449332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:28.450243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:28.451114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:28.451114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:28.451114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:28.451114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:28.451114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 423/828] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:28.457167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.558536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308130b-f478-4306-8c8b-6291b4d7c15a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.559196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308130b-f478-4306-8c8b-6291b4d7c15a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.559676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308130b-f478-4306-8c8b-6291b4d7c15a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.565342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 424/829] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:28.568135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.568698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.569232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.576741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899d347-e200-446c-8ca9-923d9a51a2bd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.591960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:28.594005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:28.615418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.616095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.616386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.616662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.617407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:28.617714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.619075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:28.634307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 406/830] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:28.639791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.683885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 425/831] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:28.707067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.756318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75cab7-305f-4ec1-81d9-d1d39e2fb874 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.798572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.800192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.800620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.801097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.804823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6ccf9-753c-4f4a-95da-a2aa18c99502 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.810665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.812273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:28.828561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:28.829665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:28.830748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:28.832523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 407/832] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:28.838098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.852625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.853849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.854277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.855662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.868562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:28.878103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:28.879178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:28.880179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:28.888054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 426/833] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:28.890113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:28.948434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654aeeb-538e-4840-93ac-d6b0b3d8f10c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:28.983574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:28.984027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:28.984412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:28.984790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:28.985732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:28.986386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:28.987980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.001732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 408/834] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:29.007767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.013375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd4c03-d51f-4e1f-999c-005a42d7e4a2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.058928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.060293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.060778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.061541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.062746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:29.063193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.065254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.080237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 427/835] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:29.081803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.124955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f3087-e69f-427a-a0cb-28bf62e4f2a2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.157813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.158707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.159052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.159255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/a459163f5d714b3f92b6e90e75deb308/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.174946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=a459163f5d714b3f92b6e90e75deb308, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.176383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.197304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 409/836] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:29 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/a459163f5d714b3f92b6e90e75deb308/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:29.208808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d37b3-012c-4412-b4c6-cf3ed901ea39 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.246167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.247349 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.247832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.248304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.260524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.262951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:29.282859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:29.284216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:29.285115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:29.285115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:29.285115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:29.285115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:29.292092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 428/837] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:29.293955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.398786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f059db-b67c-4924-a19d-26713e9fbb64 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.434243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.434912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.435197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.435469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.436183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:29.436488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.437876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.450460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 410/838] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:29.455701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.563209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674d7cd-bad7-4fdb-b17f-ad2c7745687e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.597136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.598269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.598759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.599229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.607126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.608844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-85124497-38f3-45dc-bcd4-652da097f337 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:29.623500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:29.624432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 22:06:29.625637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:29.627825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 429/839] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:29.634291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.705084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a14ce-0a66-448f-871d-8d9c61347e7c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.705765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a14ce-0a66-448f-871d-8d9c61347e7c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.706253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a14ce-0a66-448f-871d-8d9c61347e7c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.708114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 430/840] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:29.712802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.713106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.713399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.730371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:29.731561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:29.740837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460087-9562-4fb6-b0fb-8cfd337a61fc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.783979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.784653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.784932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.785375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.786276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:29.786586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.788010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.806516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 431/841] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:29.810057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 411/842] 10.222.0.13 () {56 vars in 1135 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:29.815373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.829502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:29.939674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19802-abdb-4456-9856-e86e8525e17b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.949491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64359cb-5f1b-484d-947e-4025157207e7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:29.983331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.983834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:29.984042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.984329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.984603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.984750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:29.985081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:29.985284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:29.985503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:29.986648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:29.999198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:30.001257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:30.002355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 412/843] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:30.007873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.063404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.064917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.124928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5f6a-1e2d-4083-a855-ab073a86a392 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.158498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.159193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.159476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.159750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.160450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:30.160752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.162236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.172382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 413/844] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:30.175298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.185728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 432/845] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:30.194390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.277285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41b1f2-2373-4c9d-b234-1e582bd0c9f5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.315651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.316379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.316597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.316872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.317610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:30.317913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.319486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.323135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c314-1489-4ba0-8131-2fa9a84e2db0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.325249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 414/846] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:30.365686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.366812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.367278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.367729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.379722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.381852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-9ecf216b-ee08-47d4-b62c-9ce5ebaae42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:30.401076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:30.402297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:30.403399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:30.403399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:30.403399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:30.403399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:30.405423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 433/847] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:30.414395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.483701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ec76-81d1-4ba6-8321-05a0051a3090 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.484218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ec76-81d1-4ba6-8321-05a0051a3090 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.484629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586ec76-81d1-4ba6-8321-05a0051a3090 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.486494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 434/848] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:30.492321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.492956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.493490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.512063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:30.513759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:30.529276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2816f-3b7f-46b5-bd63-dd1593ccb066 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.566986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.567689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.567970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.568246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.569277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:30.569387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.570908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.585304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 415/849] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:30.590734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.597779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 435/850] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:30.619386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.707994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870d415-bc6f-441d-898e-f037995642e3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.737928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0e1cf-b5f3-4205-b724-0b18fba6d9cd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.743915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.745017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.746535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.747064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.756918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.759212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.772479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.773337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.773622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.773900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.774551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.775919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:30.777798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:30.778777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:30.779689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:30.782366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 416/851] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:30.793438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:30.793589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:30.794687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:30.795689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:30.797136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 436/852] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:30.798151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.905549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3226b-4d3a-4bc4-9387-3dc4a40fb06a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.923611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f332-d204-432c-9cca-a364b92f4bb2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:30.940815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.941850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.942363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.942847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.943818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:30.944320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.945948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.959080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:30.959080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:30.959358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:30.959573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:30.963655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:30.963655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:30.963655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:30.964080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 417/853] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:30.965594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:30.966925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 437/854] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:30.974212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:31.067211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a94a0-dcb8-4248-a691-3c2570c1577d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:31.098276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bf68-0ad6-489e-8521-669abd13b218 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:31.110163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:31.115531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:31.119947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:31.120100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:31.120919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=d51afc0a8e1949fb8d3e346a97c56ef1) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:31.121382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:31.122837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311bd30-2c14-461b-bfd0-3644dfbbfdf5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:31.131975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 418/855] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/role_assignments?user.id=d51afc0a8e1949fb8d3e346a97c56ef1&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:31.140317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:31.141006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:31.141325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:31.141613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:31.142336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:31.142642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:31.144195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce6ca5-5a0d-4f8f-a4bd-5f1356761208 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:31.150071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 438/856] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:31.636401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33d0b-9447-4d52-8124-365c6db5514f None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:31.636806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33d0b-9447-4d52-8124-365c6db5514f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:31.637022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33d0b-9447-4d52-8124-365c6db5514f None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:31.638537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 419/857] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:31.644008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:31.644853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:31.645400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:31.662864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:31.664398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:31.735530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 439/858] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:31.759367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca33d0b-9447-4d52-8124-365c6db5514f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:31.869264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca33d0b-9447-4d52-8124-365c6db5514f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:31.904283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:31.905444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:31.905934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:31.906447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:31.917811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:31.925941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:31.926860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:06:31.927708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:31.930686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 420/859] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:31.937255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.039105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237888-febf-4bf1-bd74-7336311521f7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.073920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.074945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.075431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.075932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.076894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:32.077426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.078999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.087941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 440/860] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:32.094273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.207483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb0ff-d208-4401-adae-b356c5f45ddf None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.241540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.242703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.243210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.243709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.254994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.256925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:32.274129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:32.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:32.275902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:32.275902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:32.275902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:32.275902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:32.278338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 421/861] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:32.284547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.388351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07ce8-e4d1-4d3a-b936-bf3c579263fa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.422110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.422780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.423064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.423337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.424056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:32.424362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.425773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.438827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 441/862] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:32.444309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.551129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3111a6-a002-47d0-825e-158e9b128710 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.585693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.586850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.587339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.587852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.596146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.597832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8f625d7a-6b75-4463-8a92-f3208d54ee13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:32.613102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:32.614080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:32.615010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:32.617572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 422/863] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:32.626294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.657657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a2f1-ec4f-4c7b-b957-b16f5e0a5222 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.657954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a2f1-ec4f-4c7b-b957-b16f5e0a5222 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.658207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a2f1-ec4f-4c7b-b957-b16f5e0a5222 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.659782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 423/864] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:32.664720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.665001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.665313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.686398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:32.688153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:32.741590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd6561-ad38-48a7-8ce3-803e45a2a2b1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.758199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 424/865] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:32.781056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.789605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.790559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.791055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.791544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.793169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:32.793717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.795345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.817174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 442/866] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:32.829229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:32.907645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cd291-a65c-4d91-9c7f-6be0b5d10d80 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.928363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639bbdf-1de8-4f54-af5e-33ae41ea28d0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:32.948007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.949819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.950203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.950834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.951670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:32.953855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:32.964794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:32.965544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:32.965881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:32.966161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:32.977404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 425/867] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:32 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:33.045409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.047001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.161403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 443/868] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:33.166629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.285357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393d724-1ca1-4a75-a978-9be8d9105a20 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:33.318344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:33.319144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.319429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.319706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.331328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.332763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-a4b576ce-03b8-4a7e-8f0c-3beaa48260dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:33.350279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:33.351211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:33.352104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:33.352104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:33.352104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:33.352104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:33.352104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 426/869] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:33.357678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.408167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5575e0-853a-45ad-a8e4-4e6216a97562 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.408167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5575e0-853a-45ad-a8e4-4e6216a97562 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.408843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5575e0-853a-45ad-a8e4-4e6216a97562 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.410390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 427/870] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:33.416124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.416124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.416513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.438567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:33.440254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:33.481231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a0cc1-b81f-439a-b54e-a90a085ed30b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:33.521365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 428/871] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:33.532623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:33.533626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.534116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.534592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.535514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:33.536058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.537713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.544507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.554270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 444/872] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:33.560701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.647620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5448d-3c77-432a-a27c-73fa6dc13849 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:33.656808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d110f7-2b74-4dd1-8a9c-32ff7dc7d0e2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:33.687897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:33.688713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.688823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.689100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.689928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.691288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6f153-f6b5-4410-b93c-0a54fdcd41a0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.695978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:33.696879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.697240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.697576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.705339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.706350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 429/873] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:33 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:33.706793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.710685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb145-2612-40f4-8da6-6e79e16b95e5 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.710969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb145-2612-40f4-8da6-6e79e16b95e5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.711247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb145-2612-40f4-8da6-6e79e16b95e5 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.717483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 430/874] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:33.719964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.720539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.721030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:33.726686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:33.727657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:33.728600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:33.733091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 445/875] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:33.734125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.745407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:33.747859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:33.853446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 431/876] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:33.869830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dd017-b5ed-4c3b-b28c-eb1d2298d890 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:33.877094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:33.908816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:33.909526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:33.909810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:33.910136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:33.910934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:33.911246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:33.912682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:33.926551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 446/877] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:33.932611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:34.011830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726a16b-1328-4ef1-95dc-1112beaccf8e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:34.044087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c436-41a5-42c0-9470-9c7b077b905e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:34.058478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:34.059557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:34.059840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:34.060276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:34.061227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:34.062725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:34.076987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:34.077746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:34.078033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:34.078154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:34.079031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:34.080271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:34.081185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:34.081185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=a459163f5d714b3f92b6e90e75deb308) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:34.081185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:34.081185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:34.081707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 432/878] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:34.085317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:34.089874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 447/879] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:33 2022] GET /identity/v3/role_assignments?user.id=a459163f5d714b3f92b6e90e75deb308&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:34.196847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2b2f5-2da5-4850-a760-1fd476b19fce None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:34.240231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:34.240916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:34.241215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:34.241499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:34.242211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:34.242515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:34.243889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46131a-907d-4422-aeed-ca2f5b0303f4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:34.250056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 433/880] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:34.256088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:34.363062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cec3d-6c65-47da-9819-ce48b94f3fc4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:34.397014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:34.397707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:34.397986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:34.398262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:34.398958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:34.399283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:34.400620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edc9a7-5a6f-4e6b-b55a-060f349cf4de None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:34.405418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 448/881] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:35.350583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e82c-69c9-447d-b023-9e60c4f17876 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:35.351624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e82c-69c9-447d-b023-9e60c4f17876 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:35.352119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e82c-69c9-447d-b023-9e60c4f17876 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:35.353983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 434/882] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:35.359405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:35.360243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:35.360737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:35.379170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:35.380968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:35.449595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 449/883] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:35.472994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31e82c-69c9-447d-b023-9e60c4f17876 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:35.578324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31e82c-69c9-447d-b023-9e60c4f17876 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:35.612168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:35.612884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:35.613165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:35.613463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:35.614106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:35.615510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:35.627783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:35.628793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:35.629667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 435/884] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:35.637764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:35.737080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c48a36-e337-4cb9-a00c-712336e494fe None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:35.772343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:35.773362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:35.773856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:35.774336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:35.775260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:35.775790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:35.777471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:35.782627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 450/885] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:35.788301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:35.904930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86b551-8509-44a6-9048-4e0cc05c53b9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:35.939480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:35.940148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:35.940429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:35.940705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:35.941428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:35.941735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:35.943098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668a074-eb98-4bc6-a676-23de24889134 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:35.948876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 436/886] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:35.954946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.009165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee4f2-334d-4ebb-917c-fdb88ae2a69d None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.009502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee4f2-334d-4ebb-917c-fdb88ae2a69d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.010142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ee4f2-334d-4ebb-917c-fdb88ae2a69d None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.011125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 437/887] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:36.017465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.018043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.018533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.035190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:36.036698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:36.056737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85021e17-26c7-4ccf-8a3a-ffdd18940a6c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.092289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.092956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.093270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.093697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.094630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] RBAC: Adding query filter params (interface=public, service_id=db6710e596cd4612825bff6cb374b6ce, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:36.094940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.096499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.108381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 451/888] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:35 2022] GET /identity/v3/endpoints?service_id=db6710e596cd4612825bff6cb374b6ce&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:36.109690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.123325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 438/889] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:36.150289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.216544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceded0cf-b88f-4e47-a967-df19763f9cd4 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.252325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.252990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.253302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.253588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.254280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.256020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.262296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 452/890] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:06:36.276775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146884-4129-4ec0-b277-6b4f87e4b399 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.320002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.321274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.321767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.322246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.323182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.325422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:36.341167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:36.342170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:36.342967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:36.346085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 439/891] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:36.352653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.470612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969ca7-e091-40a3-926e-b576f684d625 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.510291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.510994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.511276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.511550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.512265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:36.512569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.513981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edd201-2333-4e2b-bb46-53bfaec066bc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.518900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 453/892] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:36.524799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.559373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216475-793c-4947-8d7d-957e00344a6d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.559687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216475-793c-4947-8d7d-957e00344a6d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.559938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216475-793c-4947-8d7d-957e00344a6d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.561732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 454/893] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:36.571622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90164-5cbe-48b9-8da3-633f088454c3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.572043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90164-5cbe-48b9-8da3-633f088454c3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.572422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a90164-5cbe-48b9-8da3-633f088454c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.589775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-36a90164-5cbe-48b9-8da3-633f088454c3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:36.591043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36a90164-5cbe-48b9-8da3-633f088454c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:36.630148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74a3f0-8e53-4f39-9542-8f0381b2fa4b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.662100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 455/894] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:36.663504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14cf3-3aa7-4bc9-b44a-856cef6f2eb4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.663797 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14cf3-3aa7-4bc9-b44a-856cef6f2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.664068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14cf3-3aa7-4bc9-b44a-856cef6f2eb4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.665490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 456/895] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:36.670275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.671175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.671349 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.671602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.671874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.672243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.672707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.673686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:36.674212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.675840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.681544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 440/896] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:36.687194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.688482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:36.689696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:36.755304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 457/897] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:36.762611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.801688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3c33e-e640-4f88-a4dc-81069e3d5460 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.836402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.837062 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.837363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.837631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.838405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] RBAC: Adding query filter params (interface=public, service_id=383be282f8124e26b90449aa48a19a3e, region_id=RegionOne) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:36.839255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.840649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:36.849357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 441/898] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/endpoints?service_id=383be282f8124e26b90449aa48a19a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:36.850407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.863055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ece68c-0758-42cb-846b-c1d721202362 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.898639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.899482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.899771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.900055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.910526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:36.918853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:36.919796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:36.920616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 458/899] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:36.921835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:36.953905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3360d-38aa-4d7b-a395-56002245727a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:36.994911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:36.995923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:36.996361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:36.996786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:36.997683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:36.999644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.016122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 442/900] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:36 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:37.017932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.035539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4a2f-05a3-4055-ae15-50f495f957f7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.103763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.105279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.105659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.106067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.106900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.108472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.118121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 459/901] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:36 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:06:37.143520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1488fb-2777-48b8-9337-6ab2939d88d7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.184400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.185543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.186028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.186504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.187478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:37.187987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.189657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.199649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 443/902] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:37.205891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.315834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b162c-1b36-42c5-a9c5-03b9883afa29 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.350389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.351557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.352055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.352543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.363701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.365462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:37.382940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:37.383954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:37.384880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:37.384880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:37.384880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:37.384880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:37.387287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 460/903] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:37.392603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.499180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78ea2d-b53b-4328-a27d-f6797575685c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.533921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.535374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.535862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.536375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.537342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:37.537908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.539468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.552097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 444/904] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:37.557819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.659836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941ce1c-657d-4b53-b18c-9e7188e605e1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.693252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.694075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.694361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.694642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.702949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.704403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:37.719471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:37.720409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:37.721520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 461/905] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:37.726451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.826555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a55986-9552-40d7-8368-8a5f76835611 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:37.860484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:37.861148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:37.861466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:37.861736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:37.862634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:37.862935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:37.864347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:37.882642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 445/906] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:37.888407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:37.991179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61523706-7ee7-46f3-9a67-0cdb53277267 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.028962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.030019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.030523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.031004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.097255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.098727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.194806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 462/907] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:38.200631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.304171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6b8b7-4f91-4640-9cbc-f68f564dd0e9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.340057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.340858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.341135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.341432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.351889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.353351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:38.371524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:38.372435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:38.373337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:38.373337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:38.373337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:38.373337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:38.373337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 446/908] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:38.382445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.490402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6b530-9c50-4789-804a-a373873d538b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.525197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.526813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.527314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.527833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.528756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:38.529297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.530884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfbae-cb6c-43ac-a913-2053cadc4917 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.542779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 463/909] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:38.553223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.583417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37f9d-7154-4253-ad81-56644df9e2c9 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.583893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37f9d-7154-4253-ad81-56644df9e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.583893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37f9d-7154-4253-ad81-56644df9e2c9 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.585403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 464/910] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:38.591026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.591575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.592059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.609240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:38.610704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:38.649605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9ab3a-1410-415f-a812-fd1bb2a22f93 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.681452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 465/911] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:38.686454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.687292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.687580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.687850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.694563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.696098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.701398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:38.711770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:38.712702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:38.715536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 447/912] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:38.717232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.807931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aef8a-6978-4d5e-be22-5380ad61eebb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.821828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a4fb-52c1-457c-a733-73e21f7ce5a3 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.845760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.846821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.847267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.847691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.848499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.850062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.859602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:38.860262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:38.860544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:38.860815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:38.861620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:38.862126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:38.863233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 22:06:38.865434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:38.866173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:38.867819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 466/913] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:38.876991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.877142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 448/914] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:38.882840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:38.973023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74386c17-f9b9-44de-92da-54bb5dad9243 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:38.985385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695fc19-8612-4869-9c31-0314536f675c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.015909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.016602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.016859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.017133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.017860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:39.018164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.019539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.025727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 467/915] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:39.033327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.033327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.033327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.033327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.033694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.033777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] RBAC: Adding query filter params (role.id=e908ed05c8904d328405b36cdddf5080, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=a459163f5d714b3f92b6e90e75deb308) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:39.033777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.033914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.046067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 449/916] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:38 2022] GET /identity/v3/role_assignments?user.id=a459163f5d714b3f92b6e90e75deb308&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=e908ed05c8904d328405b36cdddf5080 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:39.149814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adde04-cf72-4c22-a4d9-0aee310cb6f9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.188446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.189145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.189463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.189737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.190475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:39.190780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.192233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed47d9-ff0f-4ea8-aef7-5873766536b1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.198630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 468/917] 10.222.0.13 () {56 vars in 1114 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:39.204645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.312585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e77f4-14df-4d2d-9c05-646d3e8cadf9 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.346492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.347175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.347451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.347723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.348489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.350085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83756-4c0c-477b-acc9-4b019d44d2e4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.372922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 450/918] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:39.386961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa6-d521-4f63-91b3-9b9a1e2f2c36 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.387321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa6-d521-4f63-91b3-9b9a1e2f2c36 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.387535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa6-d521-4f63-91b3-9b9a1e2f2c36 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.390550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 469/919] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:39.395335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e250c-eb12-4e29-ab10-08108acaada0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.395650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e250c-eb12-4e29-ab10-08108acaada0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.395895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e250c-eb12-4e29-ab10-08108acaada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.414118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c63e250c-eb12-4e29-ab10-08108acaada0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:39.415241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c63e250c-eb12-4e29-ab10-08108acaada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:39.501317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 451/920] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:39.518862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acfa6-d521-4f63-91b3-9b9a1e2f2c36 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.559752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53d4f-e53c-48ef-98ca-aa57657bb210 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.559752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53d4f-e53c-48ef-98ca-aa57657bb210 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.559752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b53d4f-e53c-48ef-98ca-aa57657bb210 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.560438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 452/921] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:39.565901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.566184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.566456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.588617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:39.589853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:39.640413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acfa6-d521-4f63-91b3-9b9a1e2f2c36 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.671739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 453/922] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:39.680198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.681327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.681870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.682870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.683785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.685472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.693996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:39.703669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:39.704625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:39.705462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:39.711618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 470/923] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:39.712802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.811421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdb85-2ab6-407d-97f2-8f9355b84aab None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.816849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ee793-a2fb-4160-8035-047770c8a81b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:39.845602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.846267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.846548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.846818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.847513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:39.847813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.849257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.858861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 471/924] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:39.859005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:39.859715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:39.859997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:39.860175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.860270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:39.860901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:39.862282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:39.877823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:39.878902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:39.879731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 454/925] 10.222.0.13 () {56 vars in 1132 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:39.888277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:39.968345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f7ac8-0d22-47d1-8ba0-183c7f3bc6ec None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.002088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.003032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.003454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.003890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.004739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:40.005184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.006992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.016774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706122-a5ce-4755-b7d5-9acac7b7e7c1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.017024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 472/926] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:40.018351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:40.054593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.056384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.056835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.057883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.058748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:40.059201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.060701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.067345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 455/927] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:40.072306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:40.130650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e90a-07b9-4672-a08a-3b23db38ca28 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.164767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.165191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.165503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.165784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.166573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] RBAC: Adding query filter params (interface=public, service_id=e3d1e3d79e3d4d59aab4c66f41e31ee2, region_id=RegionOne) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:40.167439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.168860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.174504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 473/928] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:40 2022] GET /identity/v3/endpoints?service_id=e3d1e3d79e3d4d59aab4c66f41e31ee2&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:40.179622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:40.198231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4fdeb-82cc-4cb9-bc12-da03e3f325d2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.237721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.238374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.238663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.238939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.239650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:40.239956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.241342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.251790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 456/929] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:40.252713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:40.291430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072995a8-ae7c-4184-b72a-24042a249881 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.327167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.328223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.328714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.329243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.330145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.331727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da810109-96f8-4d65-8d48-c5416ea20c11 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.343609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 474/930] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:40 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:06:40.357986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa3245-9c4d-4803-af0a-0bd067ad7ae1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:40.395638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:40.396314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:40.396599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:40.396878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:40.397678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:40.399079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a8ac1-576d-48c7-b12d-ccc75dbad9d0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:40.424300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 457/931] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:41.410732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554cf2-7e49-4541-9b33-9e1f72252ce7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.411281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554cf2-7e49-4541-9b33-9e1f72252ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.411281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7554cf2-7e49-4541-9b33-9e1f72252ce7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.412942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 475/932] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:41.418815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.419624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.420126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.437278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:41.438760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:41.511007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 458/933] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:41.534079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7554cf2-7e49-4541-9b33-9e1f72252ce7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:41.639821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7554cf2-7e49-4541-9b33-9e1f72252ce7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:41.673035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:41.673796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.674072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.674346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.685556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-0426f92b-e5cc-4f25-a77b-8c46771168a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:41.693561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:41.694517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:41.695355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:41.700249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 476/934] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:06:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:41.701717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:41.706877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce7df-b510-4adc-b885-b40871d7eafe None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.707163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce7df-b510-4adc-b885-b40871d7eafe None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.707444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ce7df-b510-4adc-b885-b40871d7eafe None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.709060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 477/935] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:41.714169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.714455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.714739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.736418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:41.737652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:41.803904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 478/936] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:41.819029 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bc9f2-eed8-415b-ac32-387a676191f8 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:41.827670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:41.860377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:41.861404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.861834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.862410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.863442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:41.863756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:41.865129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:41.877236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 459/937] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:06:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:41.881843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:41.935409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8422f2-50c0-494c-8010-feaa5d8296b3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:41.978370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:41.979859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:41.980502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:41.980863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:41.981676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:41.983198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:41.985432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING keystone.server.flask.common [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 22:06:41.999879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938644c-c4c5-4dc7-ab14-ac343cbca62d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.008862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.sql.core [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 22:06:42.008862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 22:06:42.008862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [parameters: {'id': 'a23bd0c9aabc4d06aa5bce3ae05ac479', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 22:06:42.008862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a23bd0c9aabc4d06aa5bce3ae05ac479.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a23bd0c9aabc4d06aa5bce3ae05ac479. May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:06:42.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 22:06:42.018077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application yield resource May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.rollback() May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.force_reraise() May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise self.value May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application session.commit() May 16 22:06:42.018995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._prepare_impl() May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.flush() May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._flush(objects) May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application compat.raise_( May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application flush_context.execute() May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 22:06:42.019885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rec.execute(self) May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 22:06:42.020742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:06:42.021534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [parameters: {'id': 'a23bd0c9aabc4d06aa5bce3ae05ac479', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.022374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:42.023145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a23bd0c9aabc4d06aa5bce3ae05ac479. May 16 22:06:42.024012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.031999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 479/938] 10.222.0.13 () {60 vars in 1140 bytes} [Mon May 16 22:06:41 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:42.034530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.036278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.037083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.037403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.037683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.051583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.053685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:42.076241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:42.077175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:42.078058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:42.078058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:42.078058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:42.078058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:42.081281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 460/939] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:42.086590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.155170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e7250-0f86-45bc-aed4-aa425f748576 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.200403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.201198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.201495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.201763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.210823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.212365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.217648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a7efb-f7c6-4a40-8562-14689452ce2e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:42.226557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:42.227482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:42.228363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:42.233033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 480/940] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:42.234331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.263592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.264684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.265226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.265741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.266669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:42.267240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.268887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.286335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 461/941] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:42.287626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.335524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b612-2402-44c0-ae32-4f8636de1c2e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.370344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.370942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.371225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.371500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.372255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:42.372560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.374018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.393229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa736ef2-14a1-4ac0-8c1e-1c86a8d74059 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.401555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 481/942] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:42.432960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.434578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.435069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.435579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.444174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.446114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:42.463059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:42.464682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:42.465678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:42.468210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 462/943] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:42.474368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.592646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7c02a-e35c-475f-9d09-a690f6006ece None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.626984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.627659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.627943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.628219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.629065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:42.629396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.631096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f729-9407-41ed-b9fd-bf2b926ead56 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.649415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 482/944] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:42.654917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.692673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161a41-d852-4252-b6a2-d94bafa96b32 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.692969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161a41-d852-4252-b6a2-d94bafa96b32 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.693262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161a41-d852-4252-b6a2-d94bafa96b32 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.694854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 483/945] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:42.703234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0f82-3f9d-4e79-ac8d-27dc2b364e61 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.703234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0f82-3f9d-4e79-ac8d-27dc2b364e61 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.703234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b0f82-3f9d-4e79-ac8d-27dc2b364e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.719155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-331b0f82-3f9d-4e79-ac8d-27dc2b364e61 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:42.721054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-331b0f82-3f9d-4e79-ac8d-27dc2b364e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:42.762275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e5d7-006a-457a-80d4-ad9313638cfc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.801239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.802185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.802604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.803346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.809392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 484/946] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:42.809392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a208a6-f1f7-4c8c-b26c-0f6f830225c6 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.809392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a208a6-f1f7-4c8c-b26c-0f6f830225c6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.809392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a208a6-f1f7-4c8c-b26c-0f6f830225c6 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.813758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 485/947] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:42.814891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.815038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733316-5edf-4450-a011-0237a5d2714c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.815357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733316-5edf-4450-a011-0237a5d2714c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.815642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733316-5edf-4450-a011-0237a5d2714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.816772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:42.837860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-93733316-5edf-4450-a011-0237a5d2714c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:42.839124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-93733316-5edf-4450-a011-0237a5d2714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:42.839295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:42.840127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:42.840987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:42.840987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:42.840987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:42.840987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:42.840987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 463/948] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:42.846167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.905988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 486/949] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:42.907188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93733316-5edf-4450-a011-0237a5d2714c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:42.960039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1b0f-460a-4b86-bfa4-3c32997cf310 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:42.994593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:42.996280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:42.996763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:42.997254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:42.998091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:42.999635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.006133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93733316-5edf-4450-a011-0237a5d2714c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:43.011939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:43.012912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.018268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 464/950] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:43.019069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.046843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.047761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.048054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.048363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.049782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.050329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.051729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.066464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 487/951] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.067318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.128788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc636-2fbb-46f9-bdda-c85f8b134f8c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.161601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.162490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.162693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7ca20-cc37-42ae-a386-e809b2d4bb97 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.162798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.163038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.163680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.165037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:43.177073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:43.178127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.178952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 465/952] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:43.179752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.208920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.210450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.211302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.211790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.213172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.214247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.216213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.222852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 488/953] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.223847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.317414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087df7a-258a-4390-a2ad-94d98be2de6e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.356371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a51cc-acf7-43c1-a4e3-6565c1617729 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.358864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.359738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.360091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.360434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.367308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.368865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:43.384086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:43.384991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:43.386548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 466/954] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:43.387022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.395082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.396064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.396540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.397009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.397954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.398444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.400027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.405773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 489/955] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.406856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.504239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a9ed-333e-4039-a4a9-e1bd9848e779 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.512565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00b877-aeef-46d5-8be1-606b6b19203a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.538941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.539906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.540333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.540800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.542267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.543185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.546324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.549138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.550027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.550493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.550976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.551963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.552491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.557866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 467/956] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.557866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.559780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.573035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 490/957] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.574197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.663567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7e867-6a0e-4c49-ad2f-502a473f5ced None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.676221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac95234-13aa-4d59-9ab1-3e640916f162 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.700126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.700787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.701070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.701386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.702081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] RBAC: Adding query filter params (type=compute) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:43.702387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.704032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.709613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 468/958] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:43.710484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:43.722983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.723930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.724366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.724883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.725860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.727416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e372a-b78a-4d1f-848e-cf76280b0bcb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.761700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 491/959] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:43.844179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56c97-725d-4fd8-b3f7-e1624008461b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:43.891319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:43.892227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:43.892506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:43.892783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/a459163f5d714b3f92b6e90e75deb308/roles/e908ed05c8904d328405b36cdddf5080` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:43.895300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=a459163f5d714b3f92b6e90e75deb308, role_id=e908ed05c8904d328405b36cdddf5080)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:43.896775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b1007-a93e-41ac-a6fc-e1ece419c89c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:43.914821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 469/960] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:06:43 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/a459163f5d714b3f92b6e90e75deb308/roles/e908ed05c8904d328405b36cdddf5080 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:06:44.747290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b116-f223-47d7-a7ed-d1639cb3c0ef None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:44.747836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b116-f223-47d7-a7ed-d1639cb3c0ef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:44.747836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b116-f223-47d7-a7ed-d1639cb3c0ef None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:44.749474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 492/961] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:44.754866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:44.755256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:44.755432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:44.772764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:44.773968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:44.845318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 470/962] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:44.863106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b116-f223-47d7-a7ed-d1639cb3c0ef None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:44.968214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b116-f223-47d7-a7ed-d1639cb3c0ef None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:45.002819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:45.003404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:45.003682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:45.003954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:45.004658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:45.006385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:45.020116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.sql.core [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 22:06:45.020116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 22:06:45.020116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [parameters: {'user_id': 'cfd6a263cd1a40928a870f530baf0750', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 22:06:45.020116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79845) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:06:45.027669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:06:45.028517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application yield resource May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application next(self.gen) May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.rollback() May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.force_reraise() May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise self.value May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application session.commit() May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 22:06:45.029468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._prepare_impl() May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.session.flush() May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._flush(objects) May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application compat.raise_( May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application flush_context.execute() May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rec.execute(self) May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 22:06:45.030338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 22:06:45.031188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result = self._query(query) May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application conn.query(q) May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application result.read() May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 22:06:45.032022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cfd6a263cd1a40928a870f530baf0750', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:45.032846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 22:06:45.035264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:45.037378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 493/963] 10.222.0.13 () {60 vars in 1131 bytes} [Mon May 16 22:06:44 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:45.038248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:45.136596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43af7d5-2620-42e6-bc26-44b3c6765139 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:45.170194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:45.170990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:45.171268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:45.171539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:45.178589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:45.180007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-137f5b93-85d4-4570-9d1a-6fec16b5ed95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:45.194719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:45.196829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 22:06:45.199110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:45.203234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 471/964] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:45.203421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:45.301362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9324-0f0f-4287-af12-b1a339826ee5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:45.334441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:45.335110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:45.335388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:45.335660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:45.336450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:45.336751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:45.338993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563141a-e116-4780-aeec-45c274d72f70 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:45.381324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 494/965] 10.222.0.13 () {56 vars in 1101 bytes} [Mon May 16 22:06:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:46.037995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222715-8c6a-4b20-a020-4b3ae07dd536 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.038565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222715-8c6a-4b20-a020-4b3ae07dd536 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.038565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b222715-8c6a-4b20-a020-4b3ae07dd536 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.040053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 472/966] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:46.045230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.045673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.045853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.062843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:46.064305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:46.111323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3bd6-d8b7-43f3-9b9a-0c2783283722 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.111707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3bd6-d8b7-43f3-9b9a-0c2783283722 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.111875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3bd6-d8b7-43f3-9b9a-0c2783283722 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.113231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 473/967] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:46.118117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0b77c-1a0a-4621-8fb9-cac00302f197 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.118475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0b77c-1a0a-4621-8fb9-cac00302f197 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.118746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0b77c-1a0a-4621-8fb9-cac00302f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.132407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 495/968] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:46.136042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-35c0b77c-1a0a-4621-8fb9-cac00302f197 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:46.137235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-35c0b77c-1a0a-4621-8fb9-cac00302f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:46.155156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.202825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 474/969] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:46.204124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955bae-0190-4a66-b4b4-e1d3df37d7c6 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.204412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955bae-0190-4a66-b4b4-e1d3df37d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.204683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30955bae-0190-4a66-b4b4-e1d3df37d7c6 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.206085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 475/970] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:46.211018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.211306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.211585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.227102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:46.228271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:46.249853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76137a59-8d62-43ec-9c84-a02b9613c266 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.285975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.286608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.286894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.287173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.287899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.289432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.293431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 476/971] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:46.294325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.316128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 496/972] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:46 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:46.318459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.401284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a1e3-ee9f-4642-9ee2-cc2750bfbcde None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.445427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.446238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.446562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.446784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.447432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.448677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e53bc-336f-43df-bcf1-7a4ace6ee2fe None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.449428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:46.464000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:46.465247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:46.466199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:46.467005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 477/973] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:46.472806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.484819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.485932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.485932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.486252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.497618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:46.506146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:46.507180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:46.508021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 497/974] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:46.513153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.579844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051d902-5d59-4497-953f-4e3e95e8c3c0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.611759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2b682-2b4f-4ed3-8be1-8def166608fb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.612644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.613350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.613634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.613907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.614604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:46.614909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.616299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.621491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 478/975] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:46.626916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.647639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.648305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.648589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.648859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.649628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:46.649931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.651326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.659356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 498/976] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:46.664942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.729835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c27f1-dd59-4c8a-9f89-5c9bec0ba8c8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.765960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64726e2-68ab-43db-9314-15fd0f64a993 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.768783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.769477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.769763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.770039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.770736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:46.771042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.772537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.778341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 479/977] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:46.787150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.801087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.801929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.802214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.802661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.813733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.815177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:46.834618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:46.835640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:46.836504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:46.836504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:46.836504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:46.836504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:46.836504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 499/978] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:46.839357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.892542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e91a8-d08b-4fdc-aeea-82e1ce10fce0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.925192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.925876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.926162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.926433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.927213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] RBAC: Adding query filter params (interface=admin, service_id=e3d1e3d79e3d4d59aab4c66f41e31ee2, region_id=RegionOne) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:46.927524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.928874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.934444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 480/979] 10.222.0.13 () {56 vars in 1249 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/endpoints?service_id=e3d1e3d79e3d4d59aab4c66f41e31ee2&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:46.938389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbd5d-feef-40ab-ad73-84c06d93cf88 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:46.939520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:46.971745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:46.972413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:46.972698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:46.972976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:46.973725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:46.974031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:46.975399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:46.986944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 500/980] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:46.992301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:47.040039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d487-8676-40ee-b238-9f426f090ad7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.076673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.077307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.077645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.077866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.078532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.079893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.085971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 481/981] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:06:47.088096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b9d30-21cd-4351-9c01-7306c1c46ae9 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.124581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.125443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.125728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.126001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.134290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.136358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:47.152265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:47.153342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:47.158257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 501/982] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:06:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:47.161278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:47.265017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5b06a-6761-4b47-9c49-13278761d434 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.299483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.300157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.300439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.300714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.301607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:47.301917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.303333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.320835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 482/983] 10.222.0.13 () {56 vars in 1149 bytes} [Mon May 16 22:06:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:47.326203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:47.422222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af103bf-574b-4447-9a7a-8184f88ce73c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.454932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.455943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.456438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.456907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.523215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.525084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.623782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 502/984] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:47 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:47.625564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:47.719873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990f3a-c670-4adb-b308-c8293bd99e5a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.754027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.754817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.755100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.755373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.765475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.766900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:47.784085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:47.784962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:47.790523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:47.790523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:47.790523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:47.790523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:47.790523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 483/985] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:47.792803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:47.889961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd024b8-c5f4-4d75-9c87-4e454e552a02 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:47.924512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:47.925544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:47.926035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:47.926497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:47.927415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:47.927915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:47.929497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:47.940850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 503/986] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:47.946687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:48.041590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18216530-3fa9-4756-9a68-621a170b9508 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:48.077003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:48.077794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.078081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.078356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.086198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:48.087646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:48.101796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:48.102675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:48.108936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 484/987] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:48.110957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:48.205000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100f771-8c92-40bd-bce5-76d714257a2b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:48.238711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:48.239375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.239653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.239924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.240697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:48.241004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:48.242460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6e27c-3b8b-4c99-a3ea-91550066cbde None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:48.254854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 504/988] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:48.260887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:48.356514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad63e-42d3-4b09-845c-7c7b86b691b7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:48.387746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:48.388392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.388670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.388942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.389794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] RBAC: Adding query filter params (role.id=e908ed05c8904d328405b36cdddf5080, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=a459163f5d714b3f92b6e90e75deb308) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:48.390102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:48.391516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3771a00-ed0b-4bfc-a446-1e7d7c99ac5e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:48.405238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 485/989] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:48 2022] GET /identity/v3/role_assignments?user.id=a459163f5d714b3f92b6e90e75deb308&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=e908ed05c8904d328405b36cdddf5080 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:48.619096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15e5a-3a29-4777-b94c-3055cdd5a885 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.619331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15e5a-3a29-4777-b94c-3055cdd5a885 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.619612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e15e5a-3a29-4777-b94c-3055cdd5a885 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.620996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 505/990] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:48.626419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.626711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.626989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.643730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:48.644914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:48.709480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 486/991] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:48.732292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e15e5a-3a29-4777-b94c-3055cdd5a885 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:48.847680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e15e5a-3a29-4777-b94c-3055cdd5a885 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:48.879534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:48.880251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:48.880531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:48.881057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:48.881731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:48.883089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:48.895069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:48.896083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:48.896954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 506/992] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:48.902784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:48.998175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb613c2-4ba8-4750-bb93-145b24e823a9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.031142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.032126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.032629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.033101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.034041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:49.034576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.036111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.041381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 487/993] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:49.046625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.149840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8279832-40d8-4540-99cb-d76d225face1 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.186017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.186689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.186969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.187242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.187949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:49.188250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.189651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.199942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 507/994] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:49.201625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.298118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b3e02-4732-4143-855b-f5a1c892c5f8 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.330400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.331056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.331340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.331614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.332389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] RBAC: Adding query filter params (interface=public, service_id=22f7ccfcef0b42de990ed91042cfbe29, region_id=RegionOne) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:49.332697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.334088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791a45-2d29-4bb9-9af7-dd706222b1d0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.341256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 488/995] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/endpoints?service_id=22f7ccfcef0b42de990ed91042cfbe29&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:49.345446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.346662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b25-2869-4cb4-b89f-61882081a31b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.346956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b25-2869-4cb4-b89f-61882081a31b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.347238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413b25-2869-4cb4-b89f-61882081a31b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.348670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 489/996] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:49.353507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.353911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.354678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.370597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:49.371786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:49.436277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 490/997] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:49.449083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f3cf9-579a-4ae5-a361-61fc9380f0e5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.459245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.482226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.482883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.483163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.483435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.484107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.485492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.497430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 508/998] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:06:49.561243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedbb6e-5367-4874-a9c6-3f51049b2189 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.597335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.598163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.598445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.598717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.599374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.600751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:49.613246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:49.614298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 22:06:49.615200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:49.617388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 491/999] 10.222.0.13 () {56 vars in 1126 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:49.620686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.721592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1804a-f13d-444a-9009-2e6f217e308b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.752698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.753385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.753666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.753937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.754634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:49.754992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.756650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.766362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 509/1000] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:49.767468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:49.869242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06f64d-4bdb-4b20-a232-5c2b545c6118 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:49.901443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:49.902176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:49.902456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:49.902723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:49.903408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:49.903704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:49.905045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3dfe5-5418-4cd1-bdd2-e6c3cc471c92 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:49.909879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 492/1001] 10.222.0.13 () {56 vars in 1122 bytes} [Mon May 16 22:06:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:49.915596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:50.012980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec57ea-61aa-438a-83c7-0cc5878165d7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:50.044400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:50.045048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:50.045545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:50.046038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:50.047075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:50.048455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4466-1c67-47b6-8b40-69716dc4ee70 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:50.073462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 510/1002] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:50.762359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a336-e8c6-4f0c-b8c2-51354724e9da None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:50.762902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a336-e8c6-4f0c-b8c2-51354724e9da None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:50.762902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21a336-e8c6-4f0c-b8c2-51354724e9da None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:50.764465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 493/1003] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:50.769699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:50.770082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:50.770250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:50.786588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:50.787775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:50.868377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 511/1004] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:50.891431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21a336-e8c6-4f0c-b8c2-51354724e9da None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:50.988618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21a336-e8c6-4f0c-b8c2-51354724e9da None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:51.020888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:51.021640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.021925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.022200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] PATH_INFO: `/v3/services/image` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.022842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:51.024202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:51.035514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:51.036518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:51.037761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:51.042108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 494/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 22:06:50 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:51.043115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:51.138848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a280c8-ec97-4e9b-8ecd-cbee3d89309e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:51.171527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:51.172201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.172488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.172764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.173498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] RBAC: Adding query filter params (name=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:51.173806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:51.175194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7650b-13b6-4cc4-bf73-19d26bf1e438 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:51.179999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 512/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:51.185622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:51.283102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f57fc-9001-4d5e-a030-719c0284be7e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:51.316217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:51.316888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.317160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.317457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.318154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] RBAC: Adding query filter params (type=image) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:51.318458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:51.319799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5c8b-80d8-4265-8a1a-59c8cd47c843 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:51.333522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 495/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:51.733504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed0f0-cc76-4436-ac80-bb5f5b84bcb4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.733834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed0f0-cc76-4436-ac80-bb5f5b84bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.734069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ed0f0-cc76-4436-ac80-bb5f5b84bcb4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.735566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 513/1008] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:51.740804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.741095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.741400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.758359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:51.759519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:51.824430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 496/1009] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:51.846806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ed0f0-cc76-4436-ac80-bb5f5b84bcb4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:51.946254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ed0f0-cc76-4436-ac80-bb5f5b84bcb4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:51.977689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:51.978476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:51.979273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:51.979548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:51.980187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:51.981578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:51.992881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:51.993995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 22:06:51.995446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:51.997291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 514/1010] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:52.000806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:52.093512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b8fd9-4e82-4e80-9362-f47e2c97ddd3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:52.126768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:52.127455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.127736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.128004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.128721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:52.129024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:52.130451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:52.136413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 497/1011] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:52.142284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:52.238170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69ca6-d595-47e2-8c30-e06765dca65b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:52.269453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:52.270045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.270324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.270606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.271286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:52.271588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:52.272990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236e627-786d-4d70-88a0-4c6560cf15fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:52.278380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 515/1012] 10.222.0.13 () {56 vars in 1112 bytes} [Mon May 16 22:06:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:52.283896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:52.323209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dbdd1-ad3a-429d-aa43-d71bd2a2ce7d None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.323503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dbdd1-ad3a-429d-aa43-d71bd2a2ce7d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.323781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dbdd1-ad3a-429d-aa43-d71bd2a2ce7d None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.325159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 516/1013] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:52.330241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.330528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.330801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.347386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:52.348566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:52.387831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a869f-7f14-467d-8abc-a30fd7effa25 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:52.414413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 517/1014] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:52.421071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:52.421788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.422073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.422350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.423120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:52.424530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:52.439086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:52.448426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 498/1015] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:52.544916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c15e60-2822-4ccc-ac3f-c82319fbca0c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:52.586144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:52.586951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.587233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.587505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.589307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:52.590744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51db194-3bfb-4707-a66c-ec33a870b93d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:52.597339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 518/1016] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:52.598312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:52.698824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048417a7-09a9-4743-b989-69ed4f218971 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:52.732649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:52.733661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:52.734150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:52.734576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:52.735437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:52.736886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb1554-620b-47b3-b350-9375ca1f7295 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:52.763853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 499/1017] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:52 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:53.536343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d889-b95f-4c26-90ef-9e870bb307bd None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:53.536890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d889-b95f-4c26-90ef-9e870bb307bd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:53.536890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d889-b95f-4c26-90ef-9e870bb307bd None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:53.538413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 519/1018] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:53.543485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bad4a-a9e4-42f2-b7cd-490d2b76594a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:53.543862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bad4a-a9e4-42f2-b7cd-490d2b76594a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:53.544042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bad4a-a9e4-42f2-b7cd-490d2b76594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:53.559586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-270bad4a-a9e4-42f2-b7cd-490d2b76594a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:53.560750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-270bad4a-a9e4-42f2-b7cd-490d2b76594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:53.624025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 500/1019] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:53.646603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d889-b95f-4c26-90ef-9e870bb307bd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:53.745429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d889-b95f-4c26-90ef-9e870bb307bd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:53.777918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:53.778581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:53.778860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:53.779131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:53.779850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:53.781222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae020d43-de70-4953-b931-3f12b78eb281 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:53.794017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 520/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:06:53 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:06:54.782967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77355-dabb-4571-b85b-9e4567a0f2bd None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:54.783515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77355-dabb-4571-b85b-9e4567a0f2bd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:54.783515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77355-dabb-4571-b85b-9e4567a0f2bd None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:54.785004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 501/1021] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:54.790007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916c4b-60ce-4269-be9a-aa8c8eec66e8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:54.790380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916c4b-60ce-4269-be9a-aa8c8eec66e8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:54.790556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41916c4b-60ce-4269-be9a-aa8c8eec66e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:54.807633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-41916c4b-60ce-4269-be9a-aa8c8eec66e8 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:54.808801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-41916c4b-60ce-4269-be9a-aa8c8eec66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:54.885075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 521/1022] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:54.907961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa77355-dabb-4571-b85b-9e4567a0f2bd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.007691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa77355-dabb-4571-b85b-9e4567a0f2bd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.025775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf0c8-4716-45b4-a48e-2aa8fe362a3a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.026065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf0c8-4716-45b4-a48e-2aa8fe362a3a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.026343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebf0c8-4716-45b4-a48e-2aa8fe362a3a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.027851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 522/1023] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:55.032769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.033114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.033375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.040730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.042110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.042395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.042671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.050585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:55.051804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:55.053020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:55.061603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:55.062784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:55.063827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 502/1024] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:06:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:55.068648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.124960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 523/1025] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:55.149381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.168042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f816e1-ad4a-4c1a-8620-9943524cee7e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.200889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.201582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.201870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.202147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.202887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:55.203197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.204559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.217345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 503/1026] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:55.218189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.245058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381b7a4-a5ed-4948-8377-2aa3dd3ebc5f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.278719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.279512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.279796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.280072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.281265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.282706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.284534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 524/1027] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:55.289806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.313566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e6a55-68c8-46ac-a725-e70039c4809b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.346696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.347483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.347844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.348117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.359113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.360543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:55.376899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:55.377804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:55.378946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:55.378946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:55.378946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:55.378946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:55.378946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 504/1028] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:55.383907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.387945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380d93c-d16e-43d7-b05c-f0527f54d34a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.421312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.421986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.422269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.422545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.423246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.424680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.457244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 525/1029] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:06:55 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:55.484760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806d91a-6e91-407e-9708-16ae01a76417 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.521013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.521721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.522002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.522276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.523002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:55.523310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.524687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.537697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 505/1030] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:55.544172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.646721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfeada-1e46-4aff-903d-70e4b7615e8b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.681264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.682638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.682903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.683175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.691095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.692855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:06:55.707029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:55.708009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:55.708963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 526/1031] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:55.713973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.809882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a814d8-1547-495b-b54b-48117aea6cbb None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:55.843917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:55.844616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:55.844903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:55.845179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:55.846073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:55.846391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:55.847871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15974004-dabc-4dba-a7fc-b0ee32c40492 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:55.867934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 506/1032] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:55.873917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:55.970923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561603c1-5512-4cef-855a-196e83bde820 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.003170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.003829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.004115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.004393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.029832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69771b-1714-43e4-99e0-786d538e7842 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.030119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69771b-1714-43e4-99e0-786d538e7842 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.030393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69771b-1714-43e4-99e0-786d538e7842 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.031860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 507/1033] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:06:56.036461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.036749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.037024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.053642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:56.054765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:56.072776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.074385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.122445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 508/1034] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:56.144300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.173151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 527/1035] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 22:06:56.178848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.240222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f23f7-e3fa-4f93-a92d-adca574b30da None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.273138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0ac3c-0a69-40fc-b34f-8f1a92c91ebf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.274055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.274850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.275137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.276723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] PATH_INFO: `/v3/services/image` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.276723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.277981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:56.289301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:56.290386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:56.291270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 509/1036] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:56.296360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.308187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.308914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.309194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.309572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.319348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.320810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:56.342346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:56.343295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:56.344175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:56.344175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:56.344175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:56.344175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:56.344175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 528/1037] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:56.349065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.395185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa468-87f3-4035-acd0-480e1c4de46a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.426862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.427511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.427788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.428057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.428745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] RBAC: Adding query filter params (name=image) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.429049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.430422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.435253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 510/1038] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:56.440533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.442880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e04af8-3673-42d0-b2a2-9c20777fb3f5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.475842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.476857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.477390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.477886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.478882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.479397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.480813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.491790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 529/1039] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:56.497311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.537230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5693-5993-421b-9253-2b8125409c69 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.569398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.570275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.570553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.570825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.571518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] RBAC: Adding query filter params (type=image) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.571818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.573718 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.578619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 511/1040] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:56.583903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.594083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950b04-6799-4e5a-b462-8ada7beefe1c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.626377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.627198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.627484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.627762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.636064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.637589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:06:56.652664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:56.653740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 530/1041] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:56.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.684131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3510-2c69-4cf8-bbd7-27448d5c294f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.717845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.718514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.718798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.719073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.719853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] RBAC: Adding query filter params (interface=public, service_id=ddd6aeab2be1432ca2412cfac3cc3b08, region_id=RegionOne) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.720161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.721538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.726611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 512/1042] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/endpoints?service_id=ddd6aeab2be1432ca2412cfac3cc3b08&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:56.732612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.756995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7284-dc1f-4022-b1f2-e923fcd24f0b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.795045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.795766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.796048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.796321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.797121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.797462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.798928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.817429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 531/1043] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:56.818847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:56.834890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d50-f638-4654-95fd-3eed7bad5871 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.865733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.866440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.866727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.867000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.867665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.869017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0098d-fef8-47f6-b277-d12c96605334 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.885309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 513/1044] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:06:56.922862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da056142-a57c-4be4-ae0c-a51760123445 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:56.957826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:56.958500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:56.958783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:56.959059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:56.959899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] RBAC: Adding query filter params (role.id=e908ed05c8904d328405b36cdddf5080, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:56.960214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:56.961702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362c428-6982-4cb7-b1c4-162a63ee3b5c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:56.977340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 532/1045] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:56 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=e908ed05c8904d328405b36cdddf5080 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:57.761590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-3200-49f8-9b59-1cf8959ad9e5 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:57.761978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-3200-49f8-9b59-1cf8959ad9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:57.762181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-3200-49f8-9b59-1cf8959ad9e5 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:57.763552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 514/1046] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:57.768707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:57.769005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:57.769318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:57.786042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:57.787248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:57.851909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 533/1047] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:57.875697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486375-3200-49f8-9b59-1cf8959ad9e5 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:57.972122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486375-3200-49f8-9b59-1cf8959ad9e5 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.005111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.006198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.006480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.006748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.017386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:58.024711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:58.025648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:58.031744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 515/1048] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:58.032445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:58.128519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f69cd8-234a-4b37-89d9-43d2c1c0d414 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.161119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.161806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.162163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.162442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.163178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:58.163480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:58.164843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:58.173979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 534/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:58.179515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:58.275233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903855f2-cb90-45f3-b30d-15319b4ca639 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.307315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.308165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.308446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.308717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] PATH_INFO: `/v3/users/1ee95aafb0f24726bfb6775945116dfa` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.320853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] RBAC: Authorizing `identity:get_user(user_id=1ee95aafb0f24726bfb6775945116dfa)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:58.322340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:58.324141 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 516/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:06:58 2022] GET /identity/v3/users/1ee95aafb0f24726bfb6775945116dfa => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:58.329761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:58.424135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba11fe6-3f4c-4e29-ab01-b7ad1282c003 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.455890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.456536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.456820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.457093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.521273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:58.522734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:58.620020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 535/1051] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:06:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:06:58.621181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:58.716789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d384-3f50-45d3-a75c-3f049c9a7f3f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.748729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.749610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.749896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.750168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.751339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:58.752760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef53a9-fa6e-42c8-a500-876979d83082 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:58.759594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 517/1052] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:06:58 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:06:58.761130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:58.857733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496ed7-aebf-4cd8-a103-0c2cb7bbf96a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:58.891633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:58.892217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:58.892499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:58.892773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:58.893621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=998ea32f27524c028ee6681b90f5f163, user.id=1ee95aafb0f24726bfb6775945116dfa) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:58.893932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:58.895362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a69f-6165-45f8-87a4-08f505fa3a11 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:58.909491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 536/1053] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:06:58 2022] GET /identity/v3/role_assignments?user.id=1ee95aafb0f24726bfb6775945116dfa&scope.project.id=998ea32f27524c028ee6681b90f5f163&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:59.109050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12793-cf95-427b-a8d8-b2943d19d4c7 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.109676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12793-cf95-427b-a8d8-b2943d19d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.109676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12793-cf95-427b-a8d8-b2943d19d4c7 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.111104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 518/1054] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:59.116128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.116508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.116678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.134877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:59.136051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:59.203585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 537/1055] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:06:59.221825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222af81-4fef-4452-a796-b30054f7242c None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.222125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222af81-4fef-4452-a796-b30054f7242c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.222390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222af81-4fef-4452-a796-b30054f7242c None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.223866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 519/1056] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:06:59.226639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.228844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.229134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.229471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.247787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:06:59.248972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:06:59.313860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 520/1057] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:06:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:06:59.323971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e398e-4207-442b-a2f4-efb919d08217 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.336584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.358631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.359420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.359709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.359987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] PATH_INFO: `/v3/services/image` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.360636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.362052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:59.373612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:59.374647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:06:59.375486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 538/1058] 10.222.0.13 () {56 vars in 1105 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:06:59.380629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.439637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475a917-604b-45f9-a67a-320f468c02c6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.473074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.473850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.474127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.474395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.478782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ed77-08bc-4aac-81b8-3f99a1dd5d18 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.484460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:06:59.492560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:59.493728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:59.498094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 521/1059] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:59.499795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.517893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.518559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.518842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.519151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.519821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] RBAC: Adding query filter params (name=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:59.520127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.521506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.526921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 539/1060] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:59.532255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.601491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccefce-1cee-4a75-960b-b8b1ce034e15 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.626601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f990628-2c00-47ba-a68e-cef16a1a928f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.633721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.634385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.634664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.635498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.636237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:59.636538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.637913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.645929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 522/1061] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:59.651331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.659758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.660424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.660706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.660982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.661724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] RBAC: Adding query filter params (type=image) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:59.662055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.663412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.672646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 540/1062] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:59.673999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.747043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdf074-2886-42e5-a77f-b96307b0e24e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.769678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532423e-070a-44d7-b219-9550064823d0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.779381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.780160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.780440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.780713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.792756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.794337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.805765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.806416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.806727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.807000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.807730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.809114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:06:59.812543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:06:59.813460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:06:59.814332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:06:59.814332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:06:59.814332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:06:59.814332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:06:59.817689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 523/1063] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:06:59.819302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:06:59.837638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 541/1064] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:06:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:06:59.925119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74923-d7a1-4d39-bfab-9ee64d58ec6f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:06:59.966968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:06:59.967652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:06:59.967933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:06:59.968201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:06:59.968916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:06:59.969232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:06:59.970619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:06:59.987893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 524/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:06:59.989327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.092024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909096f2-5cc9-43b6-999c-f18d4f4759ce None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.125061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.125892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.126173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.126448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.134049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.135511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:07:00.149321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:00.150291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:00.151381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 542/1066] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:06:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:00.158155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.253761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbad097-b55e-414a-9f15-17c90f029abe None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.286452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.287119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.287423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.287665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.288484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:00.288790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.290219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.312321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 525/1067] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:07:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:00.313849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.410525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207043c3-3c58-4e3a-902a-4afcd1335a30 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.442366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.443239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.443527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.443799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.454594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.456040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:07:00.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:00.473516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:00.474709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:07:00.474709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:07:00.474709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:00.474709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:00.475186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 543/1068] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:07:00.479261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.575285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a3249-8f39-4ebe-bb5c-05cacd43d53a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.607621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.608575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.609047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.609550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.610436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:00.610918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.612450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.628550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 526/1069] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:00.629882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.726086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747792f8-1016-456d-8cab-70842835ec8c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.759071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.760709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.761225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.761728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.768496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.770214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:07:00.784742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:00.785733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:07:00.786796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:00.793242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 544/1070] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:07:00.794349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:00.890663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8b440-3825-47b7-acf6-591713e49a47 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:00.924627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:00.925357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:00.925698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:00.925978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:00.926806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:00.927116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:00.928609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33800b3-e5cd-4bb5-b973-0f7c1f80d654 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:00.943600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 527/1071] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:00.949424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.046613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272413e1-7f62-4668-8967-0d400d49c610 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.079132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.080017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.080298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.080570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/e908ed05c8904d328405b36cdddf5080` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.082798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=dd2eb7a2de50414587c7bd815d401959, role_id=e908ed05c8904d328405b36cdddf5080)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:01.084239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a282876-e722-4551-be59-0f3e002c636b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:01.105240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 545/1072] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:07:00 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/dd2eb7a2de50414587c7bd815d401959/roles/e908ed05c8904d328405b36cdddf5080 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:07:01.114205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afeed0-2535-4a01-90ad-fd145809a649 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.114491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afeed0-2535-4a01-90ad-fd145809a649 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.114788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afeed0-2535-4a01-90ad-fd145809a649 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.116216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 528/1073] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:01.122654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.122939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.123218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.141165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:01.143172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:01.214264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 546/1074] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:01.236691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afeed0-2535-4a01-90ad-fd145809a649 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.341401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afeed0-2535-4a01-90ad-fd145809a649 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.373322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.374110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.374388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.374658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.384624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:01.392671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:01.393613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:01.394434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 529/1075] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:01.400030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.494908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2f1d-9237-46ee-bdf5-f3ee3c8444d7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.526912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.527581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.527860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.528132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.528876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:01.529179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:01.530568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:01.543906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 547/1076] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:01.545100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.639853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d535470-f8f9-47fe-8cb8-fbb01dd8a27d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.671706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.672716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.673113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.673506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] PATH_INFO: `/v3/users/1ee95aafb0f24726bfb6775945116dfa` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.674776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] RBAC: Authorizing `identity:get_user(user_id=1ee95aafb0f24726bfb6775945116dfa)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:01.676277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:01.683134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 530/1077] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:01 2022] GET /identity/v3/users/1ee95aafb0f24726bfb6775945116dfa => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:01.684327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.777934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa805bb-4303-4b69-8274-5a3978d9d30d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.815409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.816363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.816718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.817061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.818382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:01.819918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78e5e-6005-45a7-869c-24e2cea59ae4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:01.826697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 548/1078] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:01 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:01.827782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:01.932151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf7ef-69e3-4111-bbc5-54be4588ed8e None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:01.964120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:01.965010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:01.965395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:01.965595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163/users/1ee95aafb0f24726bfb6775945116dfa/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:01.967530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] RBAC: Authorizing `identity:create_grant(project_id=998ea32f27524c028ee6681b90f5f163, user_id=1ee95aafb0f24726bfb6775945116dfa, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:01.968971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e2083-af2e-48d7-b5dd-b0d7fb9c2e30 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:01.982127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 531/1079] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:07:01 2022] PUT /identity/v3/projects/998ea32f27524c028ee6681b90f5f163/users/1ee95aafb0f24726bfb6775945116dfa/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:07:02.073689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e178f-3b1c-4e5b-b7a8-b8c2009335de None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:02.074039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e178f-3b1c-4e5b-b7a8-b8c2009335de None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:02.074312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e178f-3b1c-4e5b-b7a8-b8c2009335de None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:02.075764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 549/1080] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:02.081627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:02.081918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:02.082194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:02.099658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:02.100870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:02.174566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 532/1081] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:02.196338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e178f-3b1c-4e5b-b7a8-b8c2009335de None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:02.297673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e178f-3b1c-4e5b-b7a8-b8c2009335de None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:02.331952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:02.332606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:02.332887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:02.333158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:02.398258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:02.399707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:02.493449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 550/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:02.500110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:02.592412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6b57-415f-40a3-ae03-28e17df4ebec None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:02.624839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:02.625653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:02.625932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:02.626198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:02.636540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:02.637985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b56293be-167e-41f6-b7ce-6170ee7aa2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:07:02.654608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:02.655499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:02.656382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:07:02.656382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:07:02.656382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:02.656382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:02.656382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 533/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:02.662438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:02.755162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248c146-77de-42f1-b165-033c337d2cf7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:02.787590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:02.788252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:02.788531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:02.788799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:02.789537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:02.789838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:02.791322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d37497-152e-46ab-80cf-f515c6e44207 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:02.802854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 551/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:03.354734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48296a-9e7e-46f6-ba90-151a24cab8f3 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:03.355016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48296a-9e7e-46f6-ba90-151a24cab8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:03.355290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48296a-9e7e-46f6-ba90-151a24cab8f3 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:03.356637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 534/1085] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:03.361868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:03.362301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:03.362608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:03.379720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:03.381142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:03.444593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 552/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:03.468598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48296a-9e7e-46f6-ba90-151a24cab8f3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:03.564983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48296a-9e7e-46f6-ba90-151a24cab8f3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:03.596259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:03.597055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:03.597363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:03.597633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:03.607834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:03.615759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:03.616768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:03.618277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 535/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Mon May 16 22:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:03.622894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:03.716670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a028d8e-480b-448f-b8a3-22cb49b7ada9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:03.749558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e944-382f-472a-8d26-d14724c582da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:03.750225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e944-382f-472a-8d26-d14724c582da None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:03.750509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e944-382f-472a-8d26-d14724c582da None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:03.750783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e944-382f-472a-8d26-d14724c582da None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:03.751526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e944-382f-472a-8d26-d14724c582da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:03.751833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e944-382f-472a-8d26-d14724c582da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:03.753227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e944-382f-472a-8d26-d14724c582da None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:03.761268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 553/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:07:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:03.766903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:03.867917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a69e-0a74-4e11-a2ff-feab80306d14 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:03.899517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:03.900319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:03.900600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:03.900871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:03.910700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:03.912116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:07:03.929121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:03.930112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:03.931088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:07:03.931088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:07:03.931088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:03.931088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:03.931088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 536/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:03.936511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e944-382f-472a-8d26-d14724c582da None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.030000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e944-382f-472a-8d26-d14724c582da None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.064096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.064753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.065032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.065331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.066038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:04.066340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.067692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7f974-04a4-44b2-81cf-38e9faba7ae9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.078863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 554/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:04.084371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.187130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1a5a-e2fe-4cba-a96c-b5c9a85de752 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.216627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267727-52e6-4794-a6c2-1754dc7f0f4a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.216916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267727-52e6-4794-a6c2-1754dc7f0f4a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.217192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1267727-52e6-4794-a6c2-1754dc7f0f4a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.218572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 555/1091] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:07:04.218893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.219690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.219971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.220239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.223497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.223780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.224054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.227747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.229772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.240292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:04.241490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:07:04.243156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:04.244214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:04.245592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 537/1092] 10.222.0.13 () {56 vars in 1093 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:04.249871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.304135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 556/1093] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:07:04.328717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.345742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06c3a-72c2-4a31-9554-8f9b9486017d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.377698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.378365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.378643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.378911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.379725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:04.380027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.381724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.398761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 538/1094] 10.222.0.13 () {56 vars in 1133 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:04.404854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.424200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de057b3-2074-4cb8-86b3-df47fecd9549 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.463503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.464222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.464500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.464771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.474720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:04.482314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:04.483227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:04.484237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 557/1095] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:07:04.489386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.503548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282382e-bfde-4e0e-88ad-47b060ec51ce None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.536003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.536642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.536924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.537223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.582212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec1e-04b1-4999-88e2-4a48850c2e2d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.598937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.600371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.613403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.614079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.614359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.614634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.615367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:04.615672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.617025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.624853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 558/1096] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:04.630225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.696058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 539/1097] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 22:07:04.697649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.722921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d829-39c4-4030-9b16-cd767e2ef917 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.753916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.754806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.755089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.755359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] PATH_INFO: `/v3/users/1ee95aafb0f24726bfb6775945116dfa` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.756791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] RBAC: Authorizing `identity:get_user(user_id=1ee95aafb0f24726bfb6775945116dfa)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.758271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.764860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 559/1098] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/users/1ee95aafb0f24726bfb6775945116dfa => generated 285 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:04.765911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.788548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3faee-b106-43b6-9d0a-4f0eb81337ba None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.819994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.820780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.821063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.821369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.831235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.833262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:07:04.850018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:04.850923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:04.851935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:07:04.851935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:07:04.851935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:07:04.851935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:04.851935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 540/1099] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:07:04.856709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:04.861608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabbac-fd80-47d2-8170-1f1f87850bed None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.894220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.894868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.895153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.895433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.948693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d46b0-f6f0-4321-adb2-e025b1c5e8af None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:04.958741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.960184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.979810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:04.980402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:04.980683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:04.980959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:04.981693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:04.981998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:04.983329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:04.994627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 541/1100] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:04.999904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:05.051602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 560/1101] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:05.057622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:05.092914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbea7d0-f3fa-46fa-a984-bb72885ff0b7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:05.124696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:05.125506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:05.125786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:05.126058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:05.132632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:05.134080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:07:05.148111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:05.148982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:07:05.149894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:05.150318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202f6bc-6838-4092-8f6b-c3f68c24b6da None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:05.150393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 542/1102] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:07:05.154930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:05.180460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:05.181332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:05.182098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:05.182372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:05.183527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:05.184953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:05.186661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 561/1103] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:05 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:05.192417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:05.247301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40db4-a930-4086-bf6b-8a06ab63f3ab None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:05.278580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:05.279226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:05.279509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:05.279780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:05.280547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:05.280849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:05.282285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:05.284008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5059a28-1eb5-432d-a4ae-6b081248b0df None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:05.293651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 543/1104] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:05.299524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:05.317532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:05.318175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:05.318455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:05.318725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:05.319537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=998ea32f27524c028ee6681b90f5f163, user.id=1ee95aafb0f24726bfb6775945116dfa) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:05.319841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:05.321271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386c15-516d-47d5-a519-9eb807c309fc None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:05.327133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 562/1105] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:05 2022] GET /identity/v3/role_assignments?user.id=1ee95aafb0f24726bfb6775945116dfa&scope.project.id=998ea32f27524c028ee6681b90f5f163&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:05.398576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5bf35-0b99-4dcd-90b4-0761c8d2c44b None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:05.434273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:05.434942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:05.435226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:05.435504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:05.436340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] RBAC: Adding query filter params (role.id=e908ed05c8904d328405b36cdddf5080, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=dd2eb7a2de50414587c7bd815d401959) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:05.436657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:05.438171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc243f5-00a3-40a8-9e74-211bb5c138e5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:05.445069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 544/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:05 2022] GET /identity/v3/role_assignments?user.id=dd2eb7a2de50414587c7bd815d401959&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=e908ed05c8904d328405b36cdddf5080 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:07.564174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fdd69-ad33-49a4-8e8e-d4a1010eee6e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:07.564739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fdd69-ad33-49a4-8e8e-d4a1010eee6e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:07.564739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fdd69-ad33-49a4-8e8e-d4a1010eee6e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:07.566115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 563/1107] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:07.571209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:07.571620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:07.571770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:07.587808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:07.588981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:07.650905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 545/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:07.674951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fdd69-ad33-49a4-8e8e-d4a1010eee6e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:07.771172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fdd69-ad33-49a4-8e8e-d4a1010eee6e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:07.804066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:07.804864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:07.805145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:07.805447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:07.807256 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:07.808698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf36b10-7eff-48a7-bead-dfe50a0b1d98 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:07.810365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 564/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:07.816096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:07.907009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed111f0-6a7d-459f-b7a1-9569181e0a98 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:07.939030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:07.939694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:07.939973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:07.940249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:07.940944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:07.942395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338d03-a513-44e1-84cf-316b2be8da89 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:07.960344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 546/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:07:07 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:10.178382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4871-9305-4859-9fe5-d93fa82a9f5e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.178894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4871-9305-4859-9fe5-d93fa82a9f5e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.178894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e4871-9305-4859-9fe5-d93fa82a9f5e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.180199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 565/1111] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:10.186142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.186573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.186679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.203367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:10.204540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:10.266446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 547/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:10.288637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4871-9305-4859-9fe5-d93fa82a9f5e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:10.385600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e4871-9305-4859-9fe5-d93fa82a9f5e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:10.417081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:10.417975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.418260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.418536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] PATH_INFO: `/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.420009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] RBAC: Authorizing `identity:get_role(role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:10.421412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:10.422787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 566/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:10 2022] GET /identity/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:10.428626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:10.520923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a9e60-aeb2-40af-adde-871ddc1c7cdd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:10.552185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:10.553031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.553340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.553618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] PATH_INFO: `/v3/users/58ca22b2c29249c2a3230f60dea5d236` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.566286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] RBAC: Authorizing `identity:get_user(user_id=58ca22b2c29249c2a3230f60dea5d236)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:10.567703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:10.569313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 548/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:10 2022] GET /identity/v3/users/58ca22b2c29249c2a3230f60dea5d236 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:10.574973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:10.668471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008552-9b88-4029-bf3b-9beeaf29b0bb None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:10.700747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:10.701411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.701697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.701972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.764910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:10.766381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:10.858804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 567/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:10.864765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:10.960052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604908-5977-43dd-b142-30cb3ea89c46 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:10.992081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:10.992923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:10.993236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:10.993510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:10.994709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:10.996131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b14ea6-01a4-4379-aa29-7c34b06abd81 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:10.997817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 549/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:10 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:11.003798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:11.096357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8568-5239-4a71-83a1-01d6065eec6a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:11.128179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:11.129147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:11.129460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:11.129738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:11.130564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=998ea32f27524c028ee6681b90f5f163, user.id=58ca22b2c29249c2a3230f60dea5d236) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:11.131138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:11.132560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660801c8-bb29-4453-8567-f21f65cc1616 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:11.137815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 568/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:11 2022] GET /identity/v3/role_assignments?user.id=58ca22b2c29249c2a3230f60dea5d236&scope.project.id=998ea32f27524c028ee6681b90f5f163&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:13.300662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116704a-92b9-4e15-907c-53296d22e893 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.301264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116704a-92b9-4e15-907c-53296d22e893 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.301264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116704a-92b9-4e15-907c-53296d22e893 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.302597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 550/1118] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:13.308215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.308662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.308778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.325469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:13.326646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:13.388954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 569/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:13.411111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116704a-92b9-4e15-907c-53296d22e893 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:13.508045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116704a-92b9-4e15-907c-53296d22e893 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:13.538801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:13.539632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.539909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.540177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] PATH_INFO: `/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.542138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] RBAC: Authorizing `identity:get_role(role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:13.543484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:13.544815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 551/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:13 2022] GET /identity/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:13.550569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:13.642235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd21e1-1239-42c7-803a-27219e53d7dd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:13.673992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:13.674842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.675119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.675387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] PATH_INFO: `/v3/users/58ca22b2c29249c2a3230f60dea5d236` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.676545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] RBAC: Authorizing `identity:get_user(user_id=58ca22b2c29249c2a3230f60dea5d236)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:13.677990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:13.679577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 570/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:13 2022] GET /identity/v3/users/58ca22b2c29249c2a3230f60dea5d236 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:13.685568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:13.777967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b9c2-7dbc-44cd-843a-9854465f9b3a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:13.812605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:13.813486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.813766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.814035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.815187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:13.816599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c1a7a-3530-4c21-9404-e3aed8185ecc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:13.818285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 552/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:13 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:13.825434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:13.917947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8e9ff-0ba9-413d-9002-df4f00616778 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:13.949958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:13.950832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:13.951112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:13.951384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163/users/58ca22b2c29249c2a3230f60dea5d236/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:13.953595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] RBAC: Authorizing `identity:create_grant(project_id=998ea32f27524c028ee6681b90f5f163, user_id=58ca22b2c29249c2a3230f60dea5d236, role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:13.955028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001999-008e-48b1-8682-c31becb2eb87 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:13.967091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 571/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:07:13 2022] PUT /identity/v3/projects/998ea32f27524c028ee6681b90f5f163/users/58ca22b2c29249c2a3230f60dea5d236/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:07:16.133618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee903-86dd-464c-aafb-bffbdfd3886f None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.134126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee903-86dd-464c-aafb-bffbdfd3886f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.134126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee903-86dd-464c-aafb-bffbdfd3886f None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.135952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 553/1124] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:16.141223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.141661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.141788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.158260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:16.159424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:16.221608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 572/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:16.244710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee903-86dd-464c-aafb-bffbdfd3886f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:16.337159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee903-86dd-464c-aafb-bffbdfd3886f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:16.369144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:16.370007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.370298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.370570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] PATH_INFO: `/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.372034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] RBAC: Authorizing `identity:get_role(role_id=9ef0b77c6c6c4eaf96fe2bcd22191403)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:16.373420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:16.374744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 554/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:16 2022] GET /identity/v3/roles/9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:16.380175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:16.472410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead3661-3dcd-41e9-bab0-d2b6b4ae77a4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:16.503460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:16.504318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.504599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.504871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] PATH_INFO: `/v3/users/58ca22b2c29249c2a3230f60dea5d236` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.506321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] RBAC: Authorizing `identity:get_user(user_id=58ca22b2c29249c2a3230f60dea5d236)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:16.507750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:16.509905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 573/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:16 2022] GET /identity/v3/users/58ca22b2c29249c2a3230f60dea5d236 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:16.515568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:16.608308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd3b-087c-47e4-800f-beae9ad04671 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:16.640424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:16.641051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.641371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.641642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.702844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:16.704264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:16.798535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 555/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:16.804313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:16.897458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d652c4-d0f9-4225-9d4b-4466d7e75155 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:16.928597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:16.929471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:16.929754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:16.930029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] PATH_INFO: `/v3/projects/998ea32f27524c028ee6681b90f5f163` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:16.931690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] RBAC: Authorizing `identity:get_project(project_id=998ea32f27524c028ee6681b90f5f163)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:16.933116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52864d3-9094-44ee-8375-7a64f0adc067 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:16.934825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 574/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:16 2022] GET /identity/v3/projects/998ea32f27524c028ee6681b90f5f163 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:16.940968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:17.031368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca90bc-2465-4d55-b7f8-3f63757f7ee5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:17.062944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:17.063529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:17.063812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:17.064084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:17.064900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] RBAC: Adding query filter params (role.id=9ef0b77c6c6c4eaf96fe2bcd22191403, scope.project.id=998ea32f27524c028ee6681b90f5f163, user.id=58ca22b2c29249c2a3230f60dea5d236) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:17.065228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:17.066638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b268-6008-439d-acac-590df5843c59 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:17.072705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 556/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:16 2022] GET /identity/v3/role_assignments?user.id=58ca22b2c29249c2a3230f60dea5d236&scope.project.id=998ea32f27524c028ee6681b90f5f163&role.id=9ef0b77c6c6c4eaf96fe2bcd22191403 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:19.277044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739589-0523-4511-9d7e-ac8fde0ecdf3 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:19.277595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739589-0523-4511-9d7e-ac8fde0ecdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:19.277711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a739589-0523-4511-9d7e-ac8fde0ecdf3 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:19.278975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 575/1131] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:19.284227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:19.284614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:19.284788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:19.301289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:19.302490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:19.363315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 557/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:19.386227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a739589-0523-4511-9d7e-ac8fde0ecdf3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:19.498584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a739589-0523-4511-9d7e-ac8fde0ecdf3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:19.531889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:19.532599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:19.532879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:19.533149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:19.534329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:19.535759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528e08e-bbe5-4633-9561-7c62218ff55a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:19.537372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 576/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:19.543284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:19.633882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a3331-82f9-403f-ba3f-a0f2af66833b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:19.665909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:19.666549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:19.666830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:19.667103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:19.667791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:19.669273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c910-739f-4c98-9167-1b46ed50981f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:19.692453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 558/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:07:19 2022] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:21.930665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5b53-b3b1-4b29-a11d-c2e45855b97c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:21.931184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5b53-b3b1-4b29-a11d-c2e45855b97c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:21.931268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5b53-b3b1-4b29-a11d-c2e45855b97c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:21.932570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 577/1135] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:21.937715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:21.938151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:21.938268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:21.954767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:21.955924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:22.017714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 559/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:22.041735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5b53-b3b1-4b29-a11d-c2e45855b97c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:22.134880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5b53-b3b1-4b29-a11d-c2e45855b97c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:22.166800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:22.167563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:22.167839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:22.168104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:22.169274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:22.170688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db7570-3cad-4591-9986-cfa127b5bd8f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:22.172255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 578/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:22.177811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:22.267971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e68bd-f469-4220-a0a5-0b5f4fb5e486 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:22.299579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:22.300229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:22.300505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:22.300773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:22.301491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:22.302897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17babec0-5953-42e7-acdd-1943e8c6fad7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:22.321332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 560/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:07:22 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:24.547750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0031f5-9ecc-4b34-bf7b-3382953fdb83 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:24.548281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0031f5-9ecc-4b34-bf7b-3382953fdb83 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:24.548281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0031f5-9ecc-4b34-bf7b-3382953fdb83 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:24.549683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 579/1139] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:24.554775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:24.555178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:24.555327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:24.571262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:24.572425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:24.633803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 561/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:24.657025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0031f5-9ecc-4b34-bf7b-3382953fdb83 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:24.750125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0031f5-9ecc-4b34-bf7b-3382953fdb83 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:24.782059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:24.782825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:24.783103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:24.783375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:24.792891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:24.800495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:24.801678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:24.802556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 580/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:24.807454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:24.900776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadc86d-9c6f-45f6-bf6e-1f33dfda2cdd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:24.932080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:24.932736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:24.933015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:24.933312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:24.934046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:24.934349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:24.935696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:24.943297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 562/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:24.949456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:25.041549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81633a3-d6f6-418a-80ae-4206617a7db5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:25.072258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:25.073035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:25.073341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:25.073612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] PATH_INFO: `/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:25.085768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] RBAC: Authorizing `identity:get_user(user_id=2f63bbd4ba2c429fa53aeecad1d9b69f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:25.087780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:25.089396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 581/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:24 2022] GET /identity/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:25.094879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:25.187460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361913d5-0628-4662-ba0c-01e7f5b72cdc None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:25.218767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:25.219391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:25.219672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:25.219943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:25.282488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:25.283908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:25.375539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 563/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:25.381506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:25.473502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473ec4a-4b66-465f-b64c-2af9b33fae21 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:25.506248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:25.507079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:25.507356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:25.507626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] PATH_INFO: `/v3/projects/deeba33a060a457cb62def222afaa4f2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:25.508775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=deeba33a060a457cb62def222afaa4f2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:25.510263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6b606-f5ea-47d6-8cf7-40bcb5591ed4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:25.511922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 582/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:25 2022] GET /identity/v3/projects/deeba33a060a457cb62def222afaa4f2 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:25.517840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:25.609723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46c9f-a0f0-475b-a7bc-716e15771d14 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:25.642428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:25.643011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:25.643294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:25.643575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:25.644392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=deeba33a060a457cb62def222afaa4f2, user.id=2f63bbd4ba2c429fa53aeecad1d9b69f) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:25.644706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:25.646142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f824e11-7497-44ca-a2d3-8779da3c3db9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:25.651356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 564/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:25 2022] GET /identity/v3/role_assignments?user.id=2f63bbd4ba2c429fa53aeecad1d9b69f&scope.project.id=deeba33a060a457cb62def222afaa4f2&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:27.810919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1d2d-20ee-4bf0-b8ae-e5fbed7f3591 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:27.811316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1d2d-20ee-4bf0-b8ae-e5fbed7f3591 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:27.811475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1d2d-20ee-4bf0-b8ae-e5fbed7f3591 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:27.812844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 583/1147] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:27.818015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:27.818376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:27.818564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:27.834971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:27.836132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:27.897751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 565/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:27.920404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1d2d-20ee-4bf0-b8ae-e5fbed7f3591 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:28.014495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1d2d-20ee-4bf0-b8ae-e5fbed7f3591 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:28.045655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:28.046422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:28.046700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:28.046968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:28.056396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:28.064879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:28.065964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:28.066976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 584/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:28.072617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:28.162922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e2494-c9fc-4997-b064-aff7b2a85974 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:28.193831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:28.194473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:28.194749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:28.195017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:28.195742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:28.196043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:28.198045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:28.205501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 566/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:28.211136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:28.304144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060c4e3-8946-4876-a7ae-17e4f52b7e82 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:28.335821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:28.336620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:28.336925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:28.337198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] PATH_INFO: `/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:28.338397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] RBAC: Authorizing `identity:get_user(user_id=2f63bbd4ba2c429fa53aeecad1d9b69f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:28.339819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:28.341439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 585/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:28 2022] GET /identity/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:28.346980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:28.443399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f7a6-a1a4-4ab9-8844-3b000bb453ac None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:28.475234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777610a6-a292-423a-9df3-249be67d848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:28.476088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777610a6-a292-423a-9df3-249be67d848e None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:28.476372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777610a6-a292-423a-9df3-249be67d848e None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:28.476648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777610a6-a292-423a-9df3-249be67d848e None admin] PATH_INFO: `/v3/projects/deeba33a060a457cb62def222afaa4f2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:28.478354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777610a6-a292-423a-9df3-249be67d848e None admin] RBAC: Authorizing `identity:get_project(project_id=deeba33a060a457cb62def222afaa4f2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:28.479770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777610a6-a292-423a-9df3-249be67d848e None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:28.481469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 567/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:28 2022] GET /identity/v3/projects/deeba33a060a457cb62def222afaa4f2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:28.487415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:28.579623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748feac-a078-4daa-a5b6-0490e4bc6c0e None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:28.610422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:28.611225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:28.611501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:28.611768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] PATH_INFO: `/v3/projects/deeba33a060a457cb62def222afaa4f2/users/2f63bbd4ba2c429fa53aeecad1d9b69f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:28.613691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] RBAC: Authorizing `identity:create_grant(project_id=deeba33a060a457cb62def222afaa4f2, user_id=2f63bbd4ba2c429fa53aeecad1d9b69f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:28.615110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0c49c-1d30-4dba-a908-5d3151037842 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:28.627605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 586/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:07:28 2022] PUT /identity/v3/projects/deeba33a060a457cb62def222afaa4f2/users/2f63bbd4ba2c429fa53aeecad1d9b69f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:07:30.798983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2cd2-d44e-40ec-995e-aff815e1571e None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:30.799507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2cd2-d44e-40ec-995e-aff815e1571e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:30.799507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2cd2-d44e-40ec-995e-aff815e1571e None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:30.800863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 568/1154] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:30.806157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:30.806555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:30.806706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:30.823369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:30.824543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:30.886819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 587/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:30.910454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2cd2-d44e-40ec-995e-aff815e1571e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.003942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2cd2-d44e-40ec-995e-aff815e1571e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.035852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.036627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.036906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.037177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.047130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:31.054568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:31.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:31.056524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 569/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:31.061692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.154873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c02c2-662b-4cc8-97ce-c58192ca3bad None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.186651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.187305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.187589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.187867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.188604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:31.188912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:31.190303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:31.198427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 588/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:31.203959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.294120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad527aa-52e3-4f45-bc03-ccb42b042333 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.325738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.326522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.326796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.327061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] PATH_INFO: `/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.328203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] RBAC: Authorizing `identity:get_user(user_id=2f63bbd4ba2c429fa53aeecad1d9b69f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:31.329633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:31.331178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 570/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:31 2022] GET /identity/v3/users/2f63bbd4ba2c429fa53aeecad1d9b69f => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:31.336628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.428918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b5f77-c5d2-4f7d-a367-70dfdf5a7036 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.460600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.461256 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.461545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.461849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.524296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:31.525768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:31.622876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 589/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:31.628608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.720668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d794b4c-06ce-4423-8a5e-af1e1ff16925 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.754633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.755464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.755742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.756277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] PATH_INFO: `/v3/projects/deeba33a060a457cb62def222afaa4f2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.757455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] RBAC: Authorizing `identity:get_project(project_id=deeba33a060a457cb62def222afaa4f2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:31.758896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc27f6-58f4-4c16-976d-667f139891d9 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:31.760542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 571/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:31 2022] GET /identity/v3/projects/deeba33a060a457cb62def222afaa4f2 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:31.766604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:31.858267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2c8b-4918-4699-a582-887a36a979ba None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:31.889335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:31.889912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:31.890190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:31.890459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:31.891271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=deeba33a060a457cb62def222afaa4f2, user.id=2f63bbd4ba2c429fa53aeecad1d9b69f) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:31.891576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:31.892989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedf532-be8c-471c-82a9-826a61134133 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:31.898476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 590/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:31 2022] GET /identity/v3/role_assignments?user.id=2f63bbd4ba2c429fa53aeecad1d9b69f&scope.project.id=deeba33a060a457cb62def222afaa4f2&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:34.117107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50240b2-7934-4501-a0e8-e7e46455c1ee None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:34.117635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50240b2-7934-4501-a0e8-e7e46455c1ee None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:34.117635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50240b2-7934-4501-a0e8-e7e46455c1ee None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:34.119484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 572/1162] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:34.124533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:34.124951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:34.125059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:34.142015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:34.143184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:34.204859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 591/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:34.226909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50240b2-7934-4501-a0e8-e7e46455c1ee None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:34.320671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50240b2-7934-4501-a0e8-e7e46455c1ee None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:34.351986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:34.352647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:34.352928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:34.353219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:34.416826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:34.418215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:34.510471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 573/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:34.516540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:34.607083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d98f5c-38de-4081-80a1-8b524fefde5a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:34.638561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:34.639336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:34.639617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:34.639888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:34.646626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:34.648057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b0a47099-1975-46f6-9891-bdeedbeb967b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:34.661555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:34.662590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:34.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 592/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:07:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:34.669091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:34.762759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fa2e8-f857-49d5-9b0a-bfbe01f5b1f4 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:34.794459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:34.795111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:34.795395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:34.795671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:34.796375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:34.796679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:34.798114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baaff2-f088-4623-9695-9423820c78be None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:34.805044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 574/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Mon May 16 22:07:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:36.959085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9077a-e9de-4ae6-a127-2e3d7dbfd822 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:36.959598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9077a-e9de-4ae6-a127-2e3d7dbfd822 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:36.959718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9077a-e9de-4ae6-a127-2e3d7dbfd822 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:36.961001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 593/1167] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:36.966825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163514ea-50c5-4e88-a24f-14e11a3e566f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:36.967249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163514ea-50c5-4e88-a24f-14e11a3e566f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:36.967380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163514ea-50c5-4e88-a24f-14e11a3e566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:36.983390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-163514ea-50c5-4e88-a24f-14e11a3e566f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:36.984570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-163514ea-50c5-4e88-a24f-14e11a3e566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:37.046373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 575/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:37.068513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9077a-e9de-4ae6-a127-2e3d7dbfd822 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:37.164572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9077a-e9de-4ae6-a127-2e3d7dbfd822 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:37.196705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:37.197375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:37.197662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:37.197940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:37.198670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:37.200028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464301-e945-4528-b37e-b1603b58a966 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:37.214704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 594/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Mon May 16 22:07:37 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:39.450810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773646af-1ab8-4585-a0ec-cd6ee7dd2ffe None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:39.451401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773646af-1ab8-4585-a0ec-cd6ee7dd2ffe None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:39.451401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773646af-1ab8-4585-a0ec-cd6ee7dd2ffe None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:39.452718 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 576/1170] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:39.458138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:39.458536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:39.458690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:39.475107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:39.476265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:39.537997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 595/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:39.561085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773646af-1ab8-4585-a0ec-cd6ee7dd2ffe None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:39.653978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773646af-1ab8-4585-a0ec-cd6ee7dd2ffe None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:39.686729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:39.687557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:39.687834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:39.688104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] PATH_INFO: `/v3/domains/9b70aa14c0f54cd4ae3b43b631747f9d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:39.698233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9b70aa14c0f54cd4ae3b43b631747f9d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:39.699644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800a37-4dc7-43fe-a6b8-25cb867e2e61 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:39.701266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 577/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Mon May 16 22:07:39 2022] GET /identity/v3/domains/9b70aa14c0f54cd4ae3b43b631747f9d => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:39.706933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:39.798631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8c189-a7df-4841-8fc0-9a7fb952b9c3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:39.829958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:39.830606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:39.830884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:39.831154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:39.831846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:39.833363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279712-cf54-4a1c-b1b3-dbbcaaed0eb4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:39.858531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 596/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:07:39 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:42.057315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8add-78af-48bd-913e-e1da9bbd849e None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:42.057808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8add-78af-48bd-913e-e1da9bbd849e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:42.057808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa8add-78af-48bd-913e-e1da9bbd849e None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:42.059122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 578/1174] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:42.064211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:42.064588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:42.064759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:42.080752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:42.081944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:42.143285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 597/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:42.167451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8add-78af-48bd-913e-e1da9bbd849e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:42.261873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa8add-78af-48bd-913e-e1da9bbd849e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:42.292755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:42.293613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:42.293901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:42.294172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] PATH_INFO: `/v3/domains/9b70aa14c0f54cd4ae3b43b631747f9d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:42.295321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=9b70aa14c0f54cd4ae3b43b631747f9d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:42.296729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7287d-1302-48b7-911c-ace20821f3bb None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:42.298321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 579/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Mon May 16 22:07:42 2022] GET /identity/v3/domains/9b70aa14c0f54cd4ae3b43b631747f9d => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:42.303830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:42.395021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814c7e8-8b80-437e-9a41-5239f3059203 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:42.429290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:42.430269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:42.430754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:42.431174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:42.431881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:42.433338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f12ea-5170-49bd-95c7-007f5c462e16 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:42.452837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 598/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:07:42 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:07:44.687121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a1e5-04ca-4fce-a431-886580dc184e None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:44.687679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a1e5-04ca-4fce-a431-886580dc184e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:44.687679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a1e5-04ca-4fce-a431-886580dc184e None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:44.689005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 580/1178] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:44.694138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:44.694526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:44.694703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:44.711122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:44.712805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:44.777634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 599/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:44.801843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355a1e5-04ca-4fce-a431-886580dc184e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:44.897160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355a1e5-04ca-4fce-a431-886580dc184e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:44.929086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:44.929897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:44.930180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:44.930453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:44.940609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:44.948503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:44.949695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:44.950778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 581/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:44.955746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:45.048504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8764-eae4-4252-862b-23bc38ebdfeb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:45.082217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:45.082877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:45.083164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:45.083444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:45.084187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:45.084495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:45.085889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:45.094142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 600/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:45.100463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:45.191458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d881ed4-2850-4868-bd6d-8407214aef05 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:45.223017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:45.223851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:45.224129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:45.224398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] PATH_INFO: `/v3/users/8d5b8e94167a48acb63dd9e2be63f04f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:45.236371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] RBAC: Authorizing `identity:get_user(user_id=8d5b8e94167a48acb63dd9e2be63f04f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:45.237813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:45.239378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 582/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:45 2022] GET /identity/v3/users/8d5b8e94167a48acb63dd9e2be63f04f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:07:45.244985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:45.340100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a2a1-981c-46b8-9af4-481c0f9d50f3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:45.371502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:45.372137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:45.372419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:45.372692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:45.435404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:45.436851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:45.527347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 601/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:45.533268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:45.623462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bc157-988a-483a-b512-ed5218bea985 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:45.654749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:45.655577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:45.655855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:45.656122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] PATH_INFO: `/v3/projects/ab136878d44546d48cb712ae478f20d3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:45.657281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] RBAC: Authorizing `identity:get_project(project_id=ab136878d44546d48cb712ae478f20d3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:45.658683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0caf-d254-4f1b-968d-dd63382b1628 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:45.660295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 583/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:45 2022] GET /identity/v3/projects/ab136878d44546d48cb712ae478f20d3 => generated 361 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:45.666128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:45.758438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7cf6-ce56-4ace-b5f2-928eab1d4b8b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:45.790447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:45.791022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:45.791303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:45.791577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:45.792392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=ab136878d44546d48cb712ae478f20d3, user.id=8d5b8e94167a48acb63dd9e2be63f04f) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:45.792696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:45.794143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6264a30-5f6e-47e5-a142-72fd265e85e4 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:45.799330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 602/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:45 2022] GET /identity/v3/role_assignments?user.id=8d5b8e94167a48acb63dd9e2be63f04f&scope.project.id=ab136878d44546d48cb712ae478f20d3&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:47.962753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280011-c846-4b67-be64-c01ffdd3799f None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:47.963290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280011-c846-4b67-be64-c01ffdd3799f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:47.963290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9280011-c846-4b67-be64-c01ffdd3799f None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:47.964633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 584/1186] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:47.969793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:47.970231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:47.970330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:47.988845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:47.990056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:48.051831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 603/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:07:48.074424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9280011-c846-4b67-be64-c01ffdd3799f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:48.171578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9280011-c846-4b67-be64-c01ffdd3799f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:48.204301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:48.205071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:48.205380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:48.205646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:48.215014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:48.222366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:48.223414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:07:48.224427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 585/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:48.230119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:48.321629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d012890-a319-40ea-9ef7-20178bf8c632 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:48.353581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:48.354178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:48.354460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:48.354732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:48.355466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:48.355769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:48.357122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:48.364693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 604/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:48.370322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:48.465349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317a64f-17db-4e06-a5e8-b20ea959e47d None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:48.496140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:48.496981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:48.497291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:48.497562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] PATH_INFO: `/v3/users/8d5b8e94167a48acb63dd9e2be63f04f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:48.498712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d5b8e94167a48acb63dd9e2be63f04f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:48.500126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:48.501734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 586/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:48 2022] GET /identity/v3/users/8d5b8e94167a48acb63dd9e2be63f04f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:48.507686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:48.600760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717bfe-0203-493c-8f5c-853ccf2cf523 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:48.632346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:48.633133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:48.633444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:48.633726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] PATH_INFO: `/v3/projects/ab136878d44546d48cb712ae478f20d3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:48.634890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] RBAC: Authorizing `identity:get_project(project_id=ab136878d44546d48cb712ae478f20d3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:48.636308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c536e-da93-421f-a1af-da9f9f2b0785 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:48.638026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 605/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:48 2022] GET /identity/v3/projects/ab136878d44546d48cb712ae478f20d3 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:48.643792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:48.735700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d2d8-dc91-48e7-a89c-4c17bc0228c1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:48.766750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:48.767610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:48.767887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:48.768155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] PATH_INFO: `/v3/projects/ab136878d44546d48cb712ae478f20d3/users/8d5b8e94167a48acb63dd9e2be63f04f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:48.770078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab136878d44546d48cb712ae478f20d3, user_id=8d5b8e94167a48acb63dd9e2be63f04f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:48.771491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09c53e-d204-479d-b677-c76a12a3914f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:48.784001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 587/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:07:48 2022] PUT /identity/v3/projects/ab136878d44546d48cb712ae478f20d3/users/8d5b8e94167a48acb63dd9e2be63f04f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:07:50.952792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6e643-b837-4939-93ce-28ee690ac33b None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:50.953381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6e643-b837-4939-93ce-28ee690ac33b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:50.953381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6e643-b837-4939-93ce-28ee690ac33b None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:50.954729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 606/1193] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:07:50.960199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:50.960622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:50.960755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:50.978280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:07:50.979478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:07:51.041994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 588/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:07:51.068671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6e643-b837-4939-93ce-28ee690ac33b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:51.173079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6e643-b837-4939-93ce-28ee690ac33b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:51.204368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:51.205140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:51.205445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:51.205717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:51.215566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:07:51.223108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:07:51.224217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:07:51.225374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 607/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:07:51.230713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:51.322766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83261686-fa69-448f-9090-0c627ac0d08b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:51.355998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:51.356650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:51.356927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:51.357194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:51.357945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:51.358244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:51.359590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:51.367383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 589/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:51.373076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:51.470701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f56f4-e3ec-4fa3-b591-868a46780683 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:51.503944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:51.504803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:51.505084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:51.505389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] PATH_INFO: `/v3/users/8d5b8e94167a48acb63dd9e2be63f04f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:51.506823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] RBAC: Authorizing `identity:get_user(user_id=8d5b8e94167a48acb63dd9e2be63f04f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:51.508296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:51.509945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 608/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/users/8d5b8e94167a48acb63dd9e2be63f04f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:51.515625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:51.608481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff166-560c-4783-9abd-ce000e154126 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:51.640211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:51.640841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:51.641119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:51.641415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:51.703252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:51.704680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:51.796135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 590/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:07:51.802017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:51.893927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f446d5-9c19-46e1-aacf-37d16235ec9b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:51.924932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:51.925795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:51.926073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:51.926343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] PATH_INFO: `/v3/projects/ab136878d44546d48cb712ae478f20d3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:51.927484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] RBAC: Authorizing `identity:get_project(project_id=ab136878d44546d48cb712ae478f20d3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:51.928907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd8e7e-e4f2-4a5c-9877-e8d8d153d942 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:51.930654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 609/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/projects/ab136878d44546d48cb712ae478f20d3 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:07:51.936496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:07:52.028591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a0018-98ca-4bfc-8de7-c44c5e0f0b83 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:07:52.060680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:07:52.061350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:07:52.061634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:07:52.061908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:07:52.062715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=ab136878d44546d48cb712ae478f20d3, user.id=8d5b8e94167a48acb63dd9e2be63f04f) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:07:52.063018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:07:52.064414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ca0b1-9393-4249-a9ce-d559fb421f49 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:07:52.069907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 591/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:07:51 2022] GET /identity/v3/role_assignments?user.id=8d5b8e94167a48acb63dd9e2be63f04f&scope.project.id=ab136878d44546d48cb712ae478f20d3&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:51.946081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d735-6ad7-4361-917e-e85b96f915fc None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:51.946929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d735-6ad7-4361-917e-e85b96f915fc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:51.946929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d735-6ad7-4361-917e-e85b96f915fc None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:51.948157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 610/1201] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:08:51.954008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:51.954536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:51.954536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:51.973461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:08:51.974912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:08:52.073669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 592/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:08:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:08:52.097219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d735-6ad7-4361-917e-e85b96f915fc None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:52.228551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d735-6ad7-4361-917e-e85b96f915fc None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:52.275153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:52.275991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:52.276299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:52.276679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:52.288708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:52.290435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:08:52.313136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:52.314218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:52.315759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:08:52.315759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:08:52.315759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:52.315759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:08:52.315759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 611/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:08:52.322334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:52.437527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc450d-bce7-4a5e-8133-605d0873e15e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:52.475914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:52.476563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:52.476889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:52.477159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:52.477936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:52.478291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:52.479583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d569-469f-404c-b45d-908d7aa611e7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:52.493645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 593/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:08:52.500013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:52.614546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c49f6-3bd9-4bfa-a6a4-ef9ef7264cc3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:52.652219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:52.653070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:52.653339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:52.653612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:52.654335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:52.655767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02204a6-943a-432c-905b-915d31daf3ec None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:52.678984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 612/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Mon May 16 22:08:52 2022] POST /identity/v3/users => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:08:55.257357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c66292-1b30-4042-8b6a-10795cfcacfd None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:55.257944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c66292-1b30-4042-8b6a-10795cfcacfd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:55.258095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c66292-1b30-4042-8b6a-10795cfcacfd None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:55.259462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 594/1206] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:08:55.265756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:55.266259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:55.266372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:55.284356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:08:55.285592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:08:55.359258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 613/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:08:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 22:08:55.382264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c66292-1b30-4042-8b6a-10795cfcacfd None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:55.496420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c66292-1b30-4042-8b6a-10795cfcacfd None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:55.539165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:55.539886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:55.540164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:55.540437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:55.554375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:08:55.562818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:55.563800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:08:55.564687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 595/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:08:55.570390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:55.681535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af881ac5-a423-4a74-b825-4c4525353a1f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:55.717742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:55.718756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:55.719042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:55.719314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:55.720118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:55.720354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:55.721810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:55.730668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 614/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:08:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:55.737066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:55.852612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261b50-1e04-44f2-af39-abccb3253927 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:55.894606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:55.895399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:55.895687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:55.895952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:55.907670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:55.909514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:08:55.928127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:55.929073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:55.930371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:08:55.930371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:08:55.930371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:55.930371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:08:55.935494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:55.937247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 596/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:08:56.045131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390924-d05c-40b2-89f7-c468ab3245f7 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:56.087720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:56.088523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:56.088876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:56.089169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:56.089995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:56.090310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:56.091897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:56.106834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 615/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:56.113024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:56.219386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc694f-1453-43ee-878a-a411f74d02fd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:56.259679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:56.260563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:56.260846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:56.261119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:56.270085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:56.272681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:08:56.290880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:56.292104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:08:56.293036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 597/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:08:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:08:56.298146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:56.409625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1fede-9841-4123-8a31-0d6607efd713 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:56.450198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:56.451565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:56.451565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:56.451565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:56.452413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:56.452714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:56.454356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:56.476546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 616/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:08:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:08:56.482633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:56.598909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917406d-611d-4f15-8fb4-ac9a4e596397 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:56.637109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:56.637792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:56.638120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:56.638482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:56.710822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:56.712267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:56.815317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 598/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:08:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:08:56.822459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:56.930600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a1d5-8232-49a1-a06b-39ccd5fae4a5 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:56.972521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:56.973273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:56.973572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:56.973847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:56.985045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:56.986722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:08:57.006840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:57.007981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:57.009461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:08:57.009461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:08:57.009461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:08:57.009461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:08:57.009461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 617/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:08:57.013778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:57.119000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe3966-66ee-4bb3-8dac-2dd9ac7c2652 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:57.155965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:57.156665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:57.156950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:57.157288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:57.158004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:57.158366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:57.159829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:57.172610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 599/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:57.178739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:57.290771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c742f-90ec-4b4e-a6f8-4a8d4936759c None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:57.326207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:57.327058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:57.327346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:57.327624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:57.335673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:57.337382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:08:57.352249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:08:57.353183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:08:57.354089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:08:57.355906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 618/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:08:57.361751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:57.476801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d402f-e463-4cee-8097-6678d5b683e7 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:57.516002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:57.516695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:57.517723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:57.517723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:57.518070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:57.519137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:57.520400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebdc6e-486a-4a69-957e-f49b146dc0b4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:57.532817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 600/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:57.539003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:08:57.649105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff89-93ad-45d2-a3b7-e2043e1fea20 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:08:57.684574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:08:57.685344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:57.685633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:57.685913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:57.686901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=6701f4de739740c080f6abec278ae940) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:08:57.687220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:08:57.688754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7920eb1-c058-4784-8384-2eb47d5e3795 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:08:57.695291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 619/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:08:57 2022] GET /identity/v3/role_assignments?user.id=6701f4de739740c080f6abec278ae940&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:08:59.983094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940b3b8-6671-429f-a397-4305ec0537ea None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:59.983686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940b3b8-6671-429f-a397-4305ec0537ea None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:59.983686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940b3b8-6671-429f-a397-4305ec0537ea None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:08:59.985046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 601/1220] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:08:59.991369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:08:59.991794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:08:59.991994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.009755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:00.010942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:00.092286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 620/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:08:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:00.116855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940b3b8-6671-429f-a397-4305ec0537ea None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:00.238308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940b3b8-6671-429f-a397-4305ec0537ea None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:00.277922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:00.278752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:00.279033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:00.279318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.290390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:09:00.298723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:00.299868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:00.300849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 602/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:09:00.310332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:00.410346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca849d9-3af0-443b-affb-983ac2bd7ecf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:00.444521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:00.445184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:00.445492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:00.445765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.446504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] RBAC: Adding query filter params (name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:00.446812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:00.448166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:00.455944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 621/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:00.462185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:00.568331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbc53-a96e-491a-a6ed-54e3b8249b46 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:00.604244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:00.605105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:00.605419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:00.605696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.616881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:00.618430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:00.635481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:00.636533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:00.637641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:00.637641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:00.637641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:00.637641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:00.641378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 603/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:00.642665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:00.748752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb81c1-a328-462b-8068-983f13b9a217 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:00.784315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:00.784977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:00.785423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:00.785709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.786407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:00.786716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:00.788140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:00.800200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 622/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:09:00.807078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:00.914854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cddfb-d084-4ede-ade3-f456fb657426 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:00.948439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:00.949280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:00.949569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:00.949868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:00.960196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:00.962055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:09:00.977129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:00.978392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:00.979429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 604/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:09:00.984065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.087814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91866d2-d47d-496b-944f-779406e0675d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.123704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:01.124377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:01.124697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:01.124973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:01.126081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:01.126462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:01.127913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:01.146897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 623/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:09:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:01.152465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.264419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d601116-e11a-450f-acaa-2206e5b312e0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.301310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:01.302099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:01.302383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:01.303182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:01.316175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:01.318038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:01.336819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:01.337944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:01.339035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:01.339035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:01.339035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:01.339035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:01.339035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 605/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:01.343966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.443696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a15fc-d378-41fd-ba48-f84ade454d62 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.480793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:01.481574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:01.481859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:01.482133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:01.482893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:01.483160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:01.484714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:01.498393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 624/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:01.504209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.616306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f323b-e32a-48ac-88d7-6a63e4a6563c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.653291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:01.654093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:01.654374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:01.654644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:01.661541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:01.663049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:09:01.677483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:01.678564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:01.679667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:01.680406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 606/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:01.686055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.799495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a8a26-10f9-4934-91d8-bdf788722505 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.833578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:01.834810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:01.837230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:01.837230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:01.837230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:01.837230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:01.837920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d8b6-0c6c-4b19-918a-65ee400824b2 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:01.852357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 625/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:01.857885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:01.961359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4d6-be67-42ed-a4fe-1303f79b550c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:01.999642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:02.000727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:02.001104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:02.001441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/6701f4de739740c080f6abec278ae940/roles/b81d8bfb73094820a9af97abd4573265` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:02.018565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=6701f4de739740c080f6abec278ae940, role_id=b81d8bfb73094820a9af97abd4573265)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:02.020012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca341-396a-4948-b1c0-116af336b268 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:02.033326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 607/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:09:01 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/6701f4de739740c080f6abec278ae940/roles/b81d8bfb73094820a9af97abd4573265 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:09:04.436045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a666a9-e865-4113-825e-0e8d702b0e95 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:04.436608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a666a9-e865-4113-825e-0e8d702b0e95 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:04.436608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a666a9-e865-4113-825e-0e8d702b0e95 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:04.438002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 626/1233] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:04.444346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:04.444822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:04.445129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:04.464520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:04.466158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:04.540551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 608/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:04.565851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a666a9-e865-4113-825e-0e8d702b0e95 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:04.669096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a666a9-e865-4113-825e-0e8d702b0e95 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:04.703363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:04.704209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:04.704538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:04.704908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:04.715210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:09:04.722956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:04.724095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:04.725873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 627/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Mon May 16 22:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:04.730911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:04.852944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d126057-5717-4c07-ba31-87ddbaa440fb None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:04.889787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:04.890025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:04.890307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:04.890575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:04.891416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] RBAC: Adding query filter params (name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:04.891795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:04.893310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:04.903065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 609/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Mon May 16 22:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:04.908634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:05.020533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd563c-d0f0-41bd-b3d2-3ce0b63eb509 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:05.053405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:05.054255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:05.054526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:05.054836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:05.065798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:05.067290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:05.085552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:05.086733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:05.087760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:05.087760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:05.087760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:05.087760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:05.091538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 628/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:05.092846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:05.204874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290d719-0084-4260-8ab3-3bf0aed28355 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:05.239604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:05.240807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:05.241087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:05.241395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:05.242110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:05.242406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:05.243755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:05.255969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 610/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:05.262160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:05.376479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e43b2-6e7c-4063-9d9d-37243acd641f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:05.415671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:05.415671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:05.415671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:05.415671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:05.422689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:05.424293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:09:05.440121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:05.442183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:05.443970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 629/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:05.448008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:05.558442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a278-e6d1-4fe7-80f4-573da6520ff0 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:05.592923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:05.593745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:05.594098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:05.594400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:05.595333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:05.595759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:05.597530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:05.617469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 611/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:09:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:09:05.623564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:05.726106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e050b2b-092a-4891-a06d-149a70b3ff3b None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:05.763296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:05.763950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:05.764231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:05.764501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:05.832004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:05.833576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:05.940151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 630/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:09:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:09:05.948233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:06.068424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f6ff-2ac8-449e-bff3-45f0171eb4fd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:06.107649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:06.108436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:06.108711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:06.108976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:06.119420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:06.121120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:06.142468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:06.143493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:06.144368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:06.144368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:06.144368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:06.144368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:06.144368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 612/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:09:06.150197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:06.256862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea59896-9cef-40cb-92b5-81f1a35e683d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:06.292986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:06.293678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:06.293961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:06.294239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:06.294954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:06.295276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:06.296861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:06.309098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 631/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:06.314938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:06.421703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa8097-9c01-4b70-b75e-6d694e2bd304 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:06.458249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:06.459240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:06.459394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:06.459612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:06.466918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:06.468374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:09:06.482339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:06.484589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:06.486681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 613/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:06.491738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:06.590790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d1b4-6e89-420e-85a0-ba355b186c7f None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:06.623581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:06.624302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:06.624601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:06.624885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:06.625698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:06.626001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:06.627476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483665b5-e633-4715-89e0-7fc10dcd722e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:06.641059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 632/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:06.647427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:06.750578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd00b43-6a81-432e-93c8-2bea73a9d675 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:06.787447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:06.788104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:06.788386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:06.788655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:06.789517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] RBAC: Adding query filter params (role.id=b81d8bfb73094820a9af97abd4573265, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=6701f4de739740c080f6abec278ae940) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:06.789828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:06.791314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0dd6d-0267-4695-8a66-f817bd33c7d1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:06.798044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 614/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:09:06 2022] GET /identity/v3/role_assignments?user.id=6701f4de739740c080f6abec278ae940&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=b81d8bfb73094820a9af97abd4573265 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:09.132005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc43ec-d98e-4a3a-94fd-382c0779828c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.132527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc43ec-d98e-4a3a-94fd-382c0779828c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.132527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc43ec-d98e-4a3a-94fd-382c0779828c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.133861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 633/1247] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:09.139370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.139847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.139968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.159052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:09.160351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:09.229080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 615/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:09.251446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc43ec-d98e-4a3a-94fd-382c0779828c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:09.361317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc43ec-d98e-4a3a-94fd-382c0779828c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:09.396131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:09.396842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.397121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.397417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.407056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:09:09.414850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:09.415782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:09.416634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 634/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:09.422099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:09.533880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec12c9-1212-4b23-b268-3d5e71630114 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:09.568522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:09.569178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.569497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.569756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.570488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:09.570791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:09.572175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:09.580839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 616/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:09.587013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:09.695209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06812230-5aa4-441f-ae8a-cb53afc9f1f2 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:09.729058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:09.729878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.730157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.730425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.741800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:09.743836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:09.761565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:09.762665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:09.763605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:09.763605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:09.763605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:09.763605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:09.763827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 635/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:09:09.770989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:09.877836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161d32d-1d88-4fe7-99fb-de950cbeb47a None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:09.913062 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:09.913758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:09.914041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:09.914317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:09.915028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:09.915334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:09.916693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:09.928678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 617/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:09:09.934874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:10.048884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759f8a-cdad-4d3e-b631-5b8521c5bc33 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:10.084981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:10.085967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:10.086375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:10.086692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:10.095479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:10.097104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:09:10.112371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:10.113503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:10.114822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 636/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:10.119672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:10.225598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5fbb-16e0-4e92-813a-b5e18b6e4868 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:10.261799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:10.262827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:10.263136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:10.263438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:10.264311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:10.264623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:10.266250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:10.284671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 618/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:09:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:10.291699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:10.401600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191905-12b4-400c-a2fa-1d0bcc3c36ca None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:10.436203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:10.436843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:10.437131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:10.437444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:10.508287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:10.509835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:10.613798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 637/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:09:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:09:10.619824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:10.720526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c3b5-b5a7-4847-aa6b-803406bb0430 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:10.753875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:10.754683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:10.754962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:10.755759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:10.766605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:10.768176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:10.788051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:10.789348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:10.790432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:10.790432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:10.790432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:10.790432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:10.790432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 619/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:10.795190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:10.896142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc00228-f70f-4a29-93b7-adb935f6dcd3 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:10.930185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:10.931214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:10.931621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:10.932358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:10.933112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:10.933513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:10.935468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:10.949802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 638/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:10.955510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:11.065710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8f9d-8621-42b7-a1a0-b863688076ef None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:11.098568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:11.099358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:11.099639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:11.099908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:11.106276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:11.107705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:09:11.121242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:11.122317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:11.123760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 620/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 22:09:11.128248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:11.220988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507e4d-5ae5-4236-beb2-e53f3cc0d27a None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:11.252220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:11.252861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:11.253140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:11.253442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:11.254210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:11.254513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:11.255948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9dde5-0faa-4921-bb77-d5cc3afbf6d0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:11.267655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 639/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:11.273613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:11.366961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47789e2c-a2e8-498a-93d2-da7af44da644 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:11.397702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:11.398330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:11.398613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:11.398885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:11.399699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=6701f4de739740c080f6abec278ae940) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:11.400009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:11.401440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422963d-3160-4a88-a5e7-f8813e60abf4 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:11.406559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 621/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:09:11 2022] GET /identity/v3/role_assignments?user.id=6701f4de739740c080f6abec278ae940&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:13.615552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077eb4a-993c-44f5-a9a3-32815e60cd2e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:13.616107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077eb4a-993c-44f5-a9a3-32815e60cd2e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:13.616107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077eb4a-993c-44f5-a9a3-32815e60cd2e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:13.617501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 640/1261] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:13.622538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:13.622972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:13.623076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:13.639806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:13.640969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:13.702698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 622/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:13.725602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077eb4a-993c-44f5-a9a3-32815e60cd2e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:13.821156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077eb4a-993c-44f5-a9a3-32815e60cd2e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:13.857080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:13.857894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:13.858180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:13.858453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:13.868085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:09:13.875577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:13.876660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:13.877902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 641/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:13.882905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:13.984027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6ff12-08a4-4355-b1b2-c3a55aa8d3a3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.020445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.021669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.021949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.022221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.022968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:14.023255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.024595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.032281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 623/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:14.038771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.139853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08479750-6301-4c16-847e-6c96358a14d6 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.172254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.173032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.173345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.173623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.183578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.185025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:14.201709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:14.202716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:14.203750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:14.203750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:14.203750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:14.203750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:14.203750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 642/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:14.209218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.302457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec089-6143-4e5e-9c20-0826a7537335 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.334400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.335046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.335328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.335602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.336302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:14.336608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.337976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.348970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 624/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:14.354508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.448674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be6cd-a912-4ba1-bdc0-28c1c4b0800d None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.479908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.480692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.480974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.481272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] PATH_INFO: `/v3/users/placement` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.488257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.489754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:09:14.503295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:14.504385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:14.506025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 643/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:14.510888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.602895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4b04-73df-41db-ba49-68a873f64a7f None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.634703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.635347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.635624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.635894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.636697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:14.636999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.638419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.654102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 625/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:14.659446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.751749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc41aff-58dd-46cd-a1c1-c84868f41ddd None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.783674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.784445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.784729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.785002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.794942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.796377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:14.813149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:14.814171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:14.815098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:14.815098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:14.815098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:14.815098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:14.815098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 644/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:14.820609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:14.911941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a622d9d-7b4c-4184-a39a-3981dc31705c None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:14.944699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:14.945392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:14.945665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:14.945941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:14.946762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:14.947065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:14.948413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:14.960172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 626/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:14.966327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:15.062417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2729b83-1c61-4500-a328-1b9730e8d6aa None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:15.092665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:15.093457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:15.093737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:15.094008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:15.100750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:15.102196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:09:15.116331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:15.117378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:15.123020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 645/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:15.123501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:15.222857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42cb0d-14fd-4a08-86e2-d422d07089b2 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:15.254803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62617349-054c-4b30-b170-8929804d6101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:15.255478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617349-054c-4b30-b170-8929804d6101 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:15.255759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617349-054c-4b30-b170-8929804d6101 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:15.256031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62617349-054c-4b30-b170-8929804d6101 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:15.257058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617349-054c-4b30-b170-8929804d6101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:15.257390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617349-054c-4b30-b170-8929804d6101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:15.258799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62617349-054c-4b30-b170-8929804d6101 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:15.270051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 627/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:15.276002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:15.369860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708cc21-ce2d-4269-a3a1-364682bc7296 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:15.401566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:15.402439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:15.402720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:15.402995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] PATH_INFO: `/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/6701f4de739740c080f6abec278ae940/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:15.404913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=72cf6048bb224fd5aedb9aae4b78d3ce, user_id=6701f4de739740c080f6abec278ae940, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:15.406387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dba1-7fcd-464c-960d-66df9cd14f09 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:15.418752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 646/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Mon May 16 22:09:15 2022] PUT /identity/v3/projects/72cf6048bb224fd5aedb9aae4b78d3ce/users/6701f4de739740c080f6abec278ae940/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:09:17.586810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269a66a-e81c-4e46-8b5e-0e5c789f5c08 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:17.587338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269a66a-e81c-4e46-8b5e-0e5c789f5c08 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:17.587338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269a66a-e81c-4e46-8b5e-0e5c789f5c08 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:17.588684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 628/1274] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:17.593780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:17.594160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:17.594340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:17.610408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:17.611595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:17.674164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 647/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:17.697620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269a66a-e81c-4e46-8b5e-0e5c789f5c08 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:17.791329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269a66a-e81c-4e46-8b5e-0e5c789f5c08 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:17.823314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:17.824093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:17.824370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:17.824638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:17.834321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 22:09:17.841868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:17.842942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:17.844976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 629/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Mon May 16 22:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:17.848855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:17.944281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141fb8d-4699-402b-aabd-9d13d57970ce None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:17.983140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:17.983799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:17.984082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:17.984358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:17.985100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:17.985434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:17.986825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:17.995241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 648/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Mon May 16 22:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:18.000863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.093721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4d5e7-c445-4ba0-8156-5e8c680869b5 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:18.125377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:18.126142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:18.126424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:18.126698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:18.137520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:18.138956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:18.154869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:18.155903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:18.157059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:18.157059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:18.157059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:18.157059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:18.157059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 630/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:18.162000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.254650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62fbc-2092-4b76-9c6d-11dbd784cc95 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:18.285651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:18.286790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:18.287069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:18.287340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:18.288038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:18.288337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:18.289750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:18.300713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 649/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:18.306689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.399014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725e19-f63e-4645-bdf9-0c70af086261 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:18.430269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:18.431051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:18.431328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:18.431594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:18.438655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:18.440063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 22:09:18.453491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:18.454572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:18.455702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 631/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:18.460811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.552084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694ef65-178e-4bda-8428-3b2a127a3403 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:18.582736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:18.583893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:18.584177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:18.584449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:18.585281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:18.585586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:18.586986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:18.603314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 650/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Mon May 16 22:09:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:18.608781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.701012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed047-b657-476f-84cf-48f89e65abf1 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:18.731836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:18.732453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:18.732731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:18.733002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:18.794444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:18.795866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:18.887631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 632/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Mon May 16 22:09:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 22:09:18.893309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:18.997999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9640c7a-4a59-403a-aa2d-7bd75e3042cf None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:19.030044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:19.030824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:19.031099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:19.031367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:19.040680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:19.042147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 22:09:19.058448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:19.059456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:19.060449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 22:09:19.060449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 22:09:19.060449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 22:09:19.060449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:19.060449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 651/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:19.065273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:19.157701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eade80-f93f-455c-adda-e75229c5c8cd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:19.189004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:19.189679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:19.189963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:19.190234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:19.190935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:19.191236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:19.193166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:19.203633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 633/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Mon May 16 22:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:19.208955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:19.300700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c00746-efa8-4e33-a8c1-a49c7e32a563 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:19.332267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:19.333020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:19.333439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:19.333712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:19.339921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:19.341385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 22:09:19.354408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application with Lock( May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:19.355410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: ERROR keystone.server.flask.application May 16 22:09:19.356477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 652/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Mon May 16 22:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:19.361063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:19.455301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f6dc-4dfd-4dc3-8ed5-4257e45ea0ae None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:19.486722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:19.487364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:19.487645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:19.487916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:19.488680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:19.488987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:19.491022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3c013-ace3-40dd-ad05-442f5ae521b7 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:19.502244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 634/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Mon May 16 22:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:19.508489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:19.601327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78053ff-9545-4cc8-914f-cde60f04abf0 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:19.632661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:19.633321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:19.633614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:19.633892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:19.634711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] RBAC: Adding query filter params (role.id=7f564e8d2a7c46639daf40035b442e0d, scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce, user.id=6701f4de739740c080f6abec278ae940) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:19.635020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:19.636444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4268-6e78-49f2-aed6-ddf17193c68e None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:19.642003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 653/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Mon May 16 22:09:19 2022] GET /identity/v3/role_assignments?user.id=6701f4de739740c080f6abec278ae940&scope.project.id=72cf6048bb224fd5aedb9aae4b78d3ce&role.id=7f564e8d2a7c46639daf40035b442e0d => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:21.852915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b63d1-e0fd-48b6-9df1-f48aecf6d0f2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:21.853441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b63d1-e0fd-48b6-9df1-f48aecf6d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:21.853540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b63d1-e0fd-48b6-9df1-f48aecf6d0f2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:21.854815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 635/1288] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:21.860073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:21.860477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:21.860626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:21.877320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:21.878487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:21.945287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 654/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:21.964731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b63d1-e0fd-48b6-9df1-f48aecf6d0f2 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:22.064897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b63d1-e0fd-48b6-9df1-f48aecf6d0f2 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:22.096504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:22.097334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:22.097615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:22.097882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] PATH_INFO: `/v3/services/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:22.098524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:22.100428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:22.112160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:22.113419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:22.114285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 636/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:09:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:22.120030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:22.212641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0718a-dd03-46d5-bdb5-91645726a242 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:22.244373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:22.245023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:22.245332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:22.245603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:22.246292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:22.246593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:22.247948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077013bb-753e-4843-90f6-6eed5d820bb9 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:22.252517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 655/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 22:09:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:22.258365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:22.351439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf3e44-c328-4ccb-8631-67fa60ad80db None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:22.382201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:22.382837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:22.383113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:22.383513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] PATH_INFO: `/v3/services` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:22.384204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:22.384502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:22.385859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9e17-923e-4ffb-951e-0dff2bf693ed None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:22.390123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 637/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 22:09:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:24.551916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef56e1-3766-4a40-aa48-d3a957bbc02e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:24.552440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef56e1-3766-4a40-aa48-d3a957bbc02e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:24.552558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef56e1-3766-4a40-aa48-d3a957bbc02e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:24.553880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 656/1293] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:24.559182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537837fd-c887-4696-b7ab-e23fc66ef8be None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:24.559589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537837fd-c887-4696-b7ab-e23fc66ef8be None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:24.559736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537837fd-c887-4696-b7ab-e23fc66ef8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:24.575733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-537837fd-c887-4696-b7ab-e23fc66ef8be None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:24.576899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-537837fd-c887-4696-b7ab-e23fc66ef8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:24.637900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 638/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:24.659949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef56e1-3766-4a40-aa48-d3a957bbc02e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:24.755783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef56e1-3766-4a40-aa48-d3a957bbc02e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:24.796595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:24.797286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:24.797574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:24.797853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:24.798580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:24.799955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52cb58-c783-4084-8804-341351b16352 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:24.812746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 657/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Mon May 16 22:09:24 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:09:27.022913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128322-1859-4dbe-b6d1-5ea35c625fae None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.023458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128322-1859-4dbe-b6d1-5ea35c625fae None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.023617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa128322-1859-4dbe-b6d1-5ea35c625fae None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.024896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 639/1296] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:27.031022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.031432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.031621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.050419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:27.051676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:27.124202 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 658/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:27.146525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128322-1859-4dbe-b6d1-5ea35c625fae None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:27.240790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa128322-1859-4dbe-b6d1-5ea35c625fae None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:27.272483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:27.273278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.273560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.273828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.274459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:27.275806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:27.287572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:27.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:27.289875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 640/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:09:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:27.294658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:27.386021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa4352-dbd0-4980-b082-163a275fbcbf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:27.418149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:27.418799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.419081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.419356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.420052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:27.420358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:27.421747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:27.427124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 659/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 22:09:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:27.432826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:27.525505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfbec9-0ce6-4e4e-9c70-1d0f2b5cc161 None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:27.556215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:27.556846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.557126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.557426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.558187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] RBAC: Adding query filter params (interface=public, service_id=12e707c4b6c2462aaac9fa657f3e1acf, region_id=RegionOne) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:27.558499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:27.559852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a70ab-1d81-4437-9a8e-d87035192401 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:27.564556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 641/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Mon May 16 22:09:27 2022] GET /identity/v3/endpoints?service_id=12e707c4b6c2462aaac9fa657f3e1acf&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:27.570587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:27.662717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9c-5099-4a16-894f-5c8736137164 None admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:27.694827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:27.695472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:27.695754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:27.696028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:27.696697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:27.698072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557cc0a-6178-4be9-a099-6d4eaee0ab28 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:27.704585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 660/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Mon May 16 22:09:27 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:09:29.910487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000f54-fcde-4783-a3af-4329e07f9fd6 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:29.911014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000f54-fcde-4783-a3af-4329e07f9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:29.911130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c000f54-fcde-4783-a3af-4329e07f9fd6 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:29.912407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 642/1302] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:09:29.917519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:29.917898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:29.918078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:29.934589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:09:29.935778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:09:29.997303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 661/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:09:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 22:09:30.019876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000f54-fcde-4783-a3af-4329e07f9fd6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:30.113915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c000f54-fcde-4783-a3af-4329e07f9fd6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:30.144706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:30.145524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:30.145812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:30.146084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] PATH_INFO: `/v3/services/placement` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:30.146710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:30.148045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 22:09:30.159210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 22:09:30.160317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.get_or_create( May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application with Lock( May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self._enter() May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application return self.creator() May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application created_value = creator( May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: ERROR keystone.server.flask.application May 16 22:09:30.161840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 643/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Mon May 16 22:09:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 22:09:30.166747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:30.257555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e4637-8f78-48b4-be65-86f38f2c8835 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:30.288536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:30.289177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:30.289483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:30.289756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] PATH_INFO: `/v3/services` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:30.290441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:09:30.290742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:30.292084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22aa9-3d96-40b3-b01d-cdf3a1ae22d8 None admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:30.296901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 662/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Mon May 16 22:09:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:09:30.302953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:09:30.394942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126acf5b-da4a-4075-9dae-fe1a88edbfdd None admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:09:30.426052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:09:30.426710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:09:30.426989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:09:30.427256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:09:30.427980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:09:30.429373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb64d2-19c6-4c93-88be-f8bd37cfd208 None admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:09:30.447303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 644/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Mon May 16 22:09:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:10:33.720746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f727-56c4-4257-aed4-29660b0a63c7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:33.721802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f727-56c4-4257-aed4-29660b0a63c7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:33.722351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f727-56c4-4257-aed4-29660b0a63c7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:33.728513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 663/1307] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:33.730066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee61a6-f254-4a25-9b9a-ccf633e4569b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:33.730487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee61a6-f254-4a25-9b9a-ccf633e4569b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:33.730793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee61a6-f254-4a25-9b9a-ccf633e4569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:33.864653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-71ee61a6-f254-4a25-9b9a-ccf633e4569b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:33.865900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-71ee61a6-f254-4a25-9b9a-ccf633e4569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:33.994819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 645/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:10:34.043972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:34.044259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:34.044538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:34.045925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 664/1309] 10.222.0.13 () {54 vars in 964 bytes} [Mon May 16 22:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:34.052002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d62fe-6445-4db7-8086-43e8bb6315d6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:34.052510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d62fe-6445-4db7-8086-43e8bb6315d6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:34.052853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d62fe-6445-4db7-8086-43e8bb6315d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:34.139004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9a2d62fe-6445-4db7-8086-43e8bb6315d6 None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:34.140333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9a2d62fe-6445-4db7-8086-43e8bb6315d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:34.214713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 646/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Mon May 16 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:34.223709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:34.225884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:34.340135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696db30-0c58-4dc2-8f22-492311c34770 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:34.422398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:34.423335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:34.423774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:34.424726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:34.426681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:34.536731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:34.538331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8923467-63e4-4fbc-b332-e65ad273767d service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:34.557028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 665/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:37.075341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:37.075906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:37.075906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:37.077415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 647/1312] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:37.084980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d6f1-2ec8-4392-9b80-2b847c77ec80 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:37.085467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d6f1-2ec8-4392-9b80-2b847c77ec80 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:37.085691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13d6f1-2ec8-4392-9b80-2b847c77ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:37.157009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4c13d6f1-2ec8-4392-9b80-2b847c77ec80 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:37.158255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4c13d6f1-2ec8-4392-9b80-2b847c77ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:37.251669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 666/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:37.290106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:37.291689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:37.392119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daace6d-4e6c-4173-97a6-2f5170d55ad4 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:37.467695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:37.468726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:37.469248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:37.469740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:37.472149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:37.582716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:37.584539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed907cb-a611-4ef0-8f92-169151988087 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:37.604305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 648/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:40.197129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:40.197673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:40.197764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:40.199129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 667/1315] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:40.204478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505eac-85aa-4358-975f-96e3c5674df0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:40.204910 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505eac-85aa-4358-975f-96e3c5674df0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:40.205045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505eac-85aa-4358-975f-96e3c5674df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:40.267436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-57505eac-85aa-4358-975f-96e3c5674df0 None None] MFA Rules not processed for user `1e7bb7e658ec4e09934470583e782ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:40.269158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-57505eac-85aa-4358-975f-96e3c5674df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:40.362203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 649/1316] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:40.402081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:40.403585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:40.501073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd4be1-910d-4239-a313-62bd15e181bd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:40.570273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:40.570914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:40.571202 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:40.571479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:40.573112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:40.677961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:40.679325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3650-ca93-4865-b203-a11ea74c88dc service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:40.697369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 668/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:43.431808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:43.432402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:43.432402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:43.433754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 650/1318] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:43.438953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4190-8b2f-4b2d-932b-6201ca739d70 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:43.439388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4190-8b2f-4b2d-932b-6201ca739d70 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:43.440210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4190-8b2f-4b2d-932b-6201ca739d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:43.501011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ce4e4190-8b2f-4b2d-932b-6201ca739d70 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:43.502252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ce4e4190-8b2f-4b2d-932b-6201ca739d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:43.592575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 669/1319] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:43.630504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:43.632255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:43.729740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472866c5-b85f-41bf-b0fa-c3f2c6e69175 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:43.798531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:43.799745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:43.800021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:43.800286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:43.801996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:43.903787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:43.905219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a48e0-af8d-4975-8d98-233ae8a9f636 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:43.922714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 651/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:46.774734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:46.775303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:46.775303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:46.776668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 670/1321] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:46.781948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333c1-0cf6-47a4-b274-6bd5060dd58f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:46.782386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333c1-0cf6-47a4-b274-6bd5060dd58f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:46.782533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765333c1-0cf6-47a4-b274-6bd5060dd58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:46.844607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-765333c1-0cf6-47a4-b274-6bd5060dd58f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:46.846409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-765333c1-0cf6-47a4-b274-6bd5060dd58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:46.937359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 652/1322] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:46.974372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:46.976014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:47.075051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb4fae-f6b0-4446-9bf4-f8d6eccd9fef None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:47.145660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:47.146321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:47.146609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:47.146889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:47.148554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:47.254104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:47.255593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd906e-1498-4ec3-9d6b-f2880845ca8a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:47.277046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 671/1323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:49.576990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927df7c-975b-4b77-bcb3-74c3a74bd29a None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:49.577533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927df7c-975b-4b77-bcb3-74c3a74bd29a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:49.577649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927df7c-975b-4b77-bcb3-74c3a74bd29a None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:49.578925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 653/1324] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:49.584674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330eb7-be42-43e9-ac3b-37c47a7c650e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:49.585100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330eb7-be42-43e9-ac3b-37c47a7c650e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:49.585388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330eb7-be42-43e9-ac3b-37c47a7c650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:49.646526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-06330eb7-be42-43e9-ac3b-37c47a7c650e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:49.647737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-06330eb7-be42-43e9-ac3b-37c47a7c650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:49.738122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 672/1325] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:49.790169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:49.790457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:49.790735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:49.792118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 654/1326] 10.222.0.13 () {54 vars in 964 bytes} [Mon May 16 22:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:49.798245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7f7d-308f-4376-aee3-c01e67d8f46c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:49.798577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7f7d-308f-4376-aee3-c01e67d8f46c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:49.798894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b7f7d-308f-4376-aee3-c01e67d8f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:49.871561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-591b7f7d-308f-4376-aee3-c01e67d8f46c None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:49.872738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-591b7f7d-308f-4376-aee3-c01e67d8f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:49.944464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 673/1327] 10.222.0.13 () {58 vars in 1061 bytes} [Mon May 16 22:10:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:10:49.953576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:49.955109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:50.054821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e97fe7-3d74-44bb-b6ee-eabcbd65deb5 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:50.124964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:50.125649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:50.125964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:50.126239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:50.128515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:50.231866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:50.233333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97757d34-bae7-4669-8995-4af9e075c36c service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:50.251038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 655/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:52.739975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:52.740509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:52.740509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:52.741944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 674/1329] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:52.747115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd9e7-bff3-45c3-b7e9-acfa8ee814c7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:52.747543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd9e7-bff3-45c3-b7e9-acfa8ee814c7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:52.747672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dd9e7-bff3-45c3-b7e9-acfa8ee814c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:52.810704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-777dd9e7-bff3-45c3-b7e9-acfa8ee814c7 None None] MFA Rules not processed for user `1e7bb7e658ec4e09934470583e782ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:52.811901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-777dd9e7-bff3-45c3-b7e9-acfa8ee814c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:52.904488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 656/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:52.941068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:52.942598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:53.040741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451bb6-9d5c-404b-b824-bc79e770de67 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:53.109123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:53.109802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:53.110083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:53.110358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:53.112003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:53.216302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:53.217785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b471d-109e-473c-8111-713cdd36b167 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:53.235463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 675/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:55.872687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:55.873166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:55.873415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:55.874841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 657/1332] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:55.880275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5045-60b6-409d-94d1-8d90f388ff0f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:55.880684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5045-60b6-409d-94d1-8d90f388ff0f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:55.880774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a5045-60b6-409d-94d1-8d90f388ff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:55.948971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-638a5045-60b6-409d-94d1-8d90f388ff0f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:55.950348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-638a5045-60b6-409d-94d1-8d90f388ff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:56.047478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 676/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:56.082789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:56.084354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:56.183475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72fc94-2251-4688-820f-6c40e778d164 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:56.255268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:56.256006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:56.256287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:56.256814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:56.258464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:56.360072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:56.361460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037c9d-343c-4234-a71b-ec016913b4f8 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:56.379597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 658/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:10:58.655964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:58.656527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:58.656527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:58.657953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 677/1335] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:10:58.663080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73478-9a51-449a-b432-88443799a4a7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:58.663469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73478-9a51-449a-b432-88443799a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:58.663647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73478-9a51-449a-b432-88443799a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:58.725493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c7a73478-9a51-449a-b432-88443799a4a7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:10:58.726678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c7a73478-9a51-449a-b432-88443799a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:58.817168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 659/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:10:58.856086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:10:58.857666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:58.960403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c846-c954-42bb-8ac6-5d44d14d4f49 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:10:59.029225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:10:59.029885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:10:59.030171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:10:59.030447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:10:59.032090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:10:59.135787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:10:59.137234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df981-c49f-4a90-b587-7cd1c47d6f34 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:10:59.154305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 678/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:01.643217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:01.643732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:01.643824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:01.645107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 660/1338] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:01.650255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec42b-0f3b-4a8a-9249-37d083282849 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:01.650652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec42b-0f3b-4a8a-9249-37d083282849 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:01.650818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec42b-0f3b-4a8a-9249-37d083282849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:01.711696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9deec42b-0f3b-4a8a-9249-37d083282849 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:01.712886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9deec42b-0f3b-4a8a-9249-37d083282849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:01.803629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 679/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:01.839714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:01.841223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:01.939912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800479-aa0d-4830-aac6-361ad397111d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:02.010814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:02.011539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:02.011879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:02.012154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:02.013857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:02.121711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:02.123058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c04bcb-80e3-4406-9a5a-bbd6c0eb40d9 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:02.140850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 661/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:06.466875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:06.467395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:06.467485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:06.468814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 680/1341] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:06.474611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f90b0-4364-4807-862f-f7f7ab9a702d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:06.475025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f90b0-4364-4807-862f-f7f7ab9a702d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:06.475172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f90b0-4364-4807-862f-f7f7ab9a702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:06.542130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-456f90b0-4364-4807-862f-f7f7ab9a702d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:06.543315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-456f90b0-4364-4807-862f-f7f7ab9a702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:06.642318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 662/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:11:06.680699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:06.682902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:06.773962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003bcc3-51d3-49c2-bc9f-e46652b944df None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:06.777382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:06.778027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:06.778307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:06.778580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:06.787300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:06.788727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f889206-e34b-410e-b5a5-f85574204b4a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:06.798630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 681/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:09.601639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0084d7f-c9e3-41b9-ac1a-8de23f78968b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:09.602163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0084d7f-c9e3-41b9-ac1a-8de23f78968b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:09.602163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0084d7f-c9e3-41b9-ac1a-8de23f78968b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:09.603496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 663/1344] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:09.608726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36b43-95b2-42d6-9f1b-b5b28ce52bbc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:09.609155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36b43-95b2-42d6-9f1b-b5b28ce52bbc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:09.609324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36b43-95b2-42d6-9f1b-b5b28ce52bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:09.635652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-08d36b43-95b2-42d6-9f1b-b5b28ce52bbc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:09.636821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-08d36b43-95b2-42d6-9f1b-b5b28ce52bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:09.708874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 682/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:09.744741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0084d7f-c9e3-41b9-ac1a-8de23f78968b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:09.755583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0084d7f-c9e3-41b9-ac1a-8de23f78968b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:09.759378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:09.760007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:09.760288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:09.760562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:09.769958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:09.771322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd126349-2517-42a0-96f3-c655c72e007e service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:09.780578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 664/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:13.850585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0929-958a-458c-8311-47ccedcf22a4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:13.851137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0929-958a-458c-8311-47ccedcf22a4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:13.851137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0929-958a-458c-8311-47ccedcf22a4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:13.852506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 683/1347] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:13.857763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816e81-5005-483c-b76e-6b203e8650ff None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:13.858166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816e81-5005-483c-b76e-6b203e8650ff None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:13.858323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816e81-5005-483c-b76e-6b203e8650ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:13.875517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f6816e81-5005-483c-b76e-6b203e8650ff None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:13.876744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f6816e81-5005-483c-b76e-6b203e8650ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:13.884946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 665/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:11:13.923197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a0929-958a-458c-8311-47ccedcf22a4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:13.933882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a0929-958a-458c-8311-47ccedcf22a4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:13.937328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:13.937955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:13.938233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:13.938533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:13.948672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:13.950510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76929d7-efb0-486e-b950-c363d627527b service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:13.960445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 684/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:19.230207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41253-dfa6-4a42-bcbc-24296b470920 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:19.231149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41253-dfa6-4a42-bcbc-24296b470920 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:19.231648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df41253-dfa6-4a42-bcbc-24296b470920 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:19.233682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 666/1350] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:19.239646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6d32-905e-4ad8-9f30-9def067f0220 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:19.240495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6d32-905e-4ad8-9f30-9def067f0220 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:19.240974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d6d32-905e-4ad8-9f30-9def067f0220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:19.318815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5b5d6d32-905e-4ad8-9f30-9def067f0220 None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:19.320562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5b5d6d32-905e-4ad8-9f30-9def067f0220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:19.398504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 685/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:11:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:23.735599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec038-46ba-41b9-a994-11e23c764d92 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:23.736115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec038-46ba-41b9-a994-11e23c764d92 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:23.736115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec038-46ba-41b9-a994-11e23c764d92 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:23.737695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 667/1352] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:23.742584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a19fb-545f-4e25-90e0-1522bb354fdc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:23.742980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a19fb-545f-4e25-90e0-1522bb354fdc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:23.743220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a19fb-545f-4e25-90e0-1522bb354fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:23.762911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-075a19fb-545f-4e25-90e0-1522bb354fdc None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:23.764374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-075a19fb-545f-4e25-90e0-1522bb354fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:23.773721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 686/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:25.232534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcede2-0a37-44cf-9bfd-be95752480bb None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:25.233091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcede2-0a37-44cf-9bfd-be95752480bb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:25.233091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcede2-0a37-44cf-9bfd-be95752480bb None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:25.234496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 668/1354] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:25.240127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ff-bb15-43ad-b59d-26c77d9b1dfa None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:25.240897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ff-bb15-43ad-b59d-26c77d9b1dfa None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:25.241173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ff-bb15-43ad-b59d-26c77d9b1dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:25.259931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0ee692ff-bb15-43ad-b59d-26c77d9b1dfa None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:25.261112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0ee692ff-bb15-43ad-b59d-26c77d9b1dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:25.269737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 687/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:29.138426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f46c8-c914-455e-9181-af55a2f77e73 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:29.138976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f46c8-c914-455e-9181-af55a2f77e73 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:29.138976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f46c8-c914-455e-9181-af55a2f77e73 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:29.140329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 669/1356] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:29.146051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1c15-7604-4950-b9b4-9c8801b659ff None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:29.146460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1c15-7604-4950-b9b4-9c8801b659ff None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:29.146597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf1c15-7604-4950-b9b4-9c8801b659ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:29.165297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1ddf1c15-7604-4950-b9b4-9c8801b659ff None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:29.166562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1ddf1c15-7604-4950-b9b4-9c8801b659ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:29.174711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 688/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:29.222462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ef33-2a24-4419-a3a1-db0307dd6d75 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:29.222749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ef33-2a24-4419-a3a1-db0307dd6d75 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:29.223024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195ef33-2a24-4419-a3a1-db0307dd6d75 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:29.224495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 670/1358] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:29.229661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b32fe-7afa-4b9d-9a62-b9527d0b854b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:29.229950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b32fe-7afa-4b9d-9a62-b9527d0b854b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:29.230229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b32fe-7afa-4b9d-9a62-b9527d0b854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:29.277149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-598b32fe-7afa-4b9d-9a62-b9527d0b854b None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:29.278352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-598b32fe-7afa-4b9d-9a62-b9527d0b854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:29.362914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 689/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 22:11:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:29.370853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195ef33-2a24-4419-a3a1-db0307dd6d75 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:29.386210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195ef33-2a24-4419-a3a1-db0307dd6d75 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:29.392283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:29.392855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:29.393133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:29.393437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:29.401292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:29.403341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fc4cc-63db-4a9f-9900-dd8206eb983f service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:29.412406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 671/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:31.845956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c74f-46e1-40de-b9e6-635d9aaeb343 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:31.846507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c74f-46e1-40de-b9e6-635d9aaeb343 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:31.846507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6c74f-46e1-40de-b9e6-635d9aaeb343 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:31.849237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 690/1361] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:31.853009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9450-3855-4646-805c-71b63d579ac7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:31.853427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9450-3855-4646-805c-71b63d579ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:31.853597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9450-3855-4646-805c-71b63d579ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:31.871005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-437b9450-3855-4646-805c-71b63d579ac7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:31.872204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-437b9450-3855-4646-805c-71b63d579ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:31.880090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 672/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:31.925001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c74f-46e1-40de-b9e6-635d9aaeb343 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:31.939503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6c74f-46e1-40de-b9e6-635d9aaeb343 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:31.945686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:31.946465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:31.946780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:31.947064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:31.956347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:31.958181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1ca4b-71e3-4301-a57f-e510782f4d3b service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:31.968385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 691/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:34.531536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405773-3884-4a83-97d2-4167ca7a2ac2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:34.532037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405773-3884-4a83-97d2-4167ca7a2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:34.532165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8405773-3884-4a83-97d2-4167ca7a2ac2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:34.533476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 673/1364] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:34.538698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdac02-9b9c-40aa-aa90-2ec274b67b11 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:34.539453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdac02-9b9c-40aa-aa90-2ec274b67b11 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:34.539883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdac02-9b9c-40aa-aa90-2ec274b67b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:34.558270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-33fdac02-9b9c-40aa-aa90-2ec274b67b11 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:34.559469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-33fdac02-9b9c-40aa-aa90-2ec274b67b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:34.568542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 692/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:34.613894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa668aa-3a97-46cc-9a93-7a6e6fa72172 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:34.615043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa668aa-3a97-46cc-9a93-7a6e6fa72172 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:34.615494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa668aa-3a97-46cc-9a93-7a6e6fa72172 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:34.616900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 674/1366] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 22:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:34.624236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb016c-c30c-4de0-95d4-2c13add84625 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:34.624236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb016c-c30c-4de0-95d4-2c13add84625 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:34.624236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb016c-c30c-4de0-95d4-2c13add84625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:34.649281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-10fb016c-c30c-4de0-95d4-2c13add84625 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:34.650511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-10fb016c-c30c-4de0-95d4-2c13add84625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:34.660984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 693/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:34.669148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa668aa-3a97-46cc-9a93-7a6e6fa72172 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:34.683158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa668aa-3a97-46cc-9a93-7a6e6fa72172 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:34.689028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:34.689708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:34.689994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:34.690273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:34.698231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:34.699771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b6fca-c746-4cfb-88fc-6afd6121c900 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:34.709542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 675/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:37.002865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059082-3ac6-4649-8f9f-4cf319a5c93a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.003451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059082-3ac6-4649-8f9f-4cf319a5c93a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.003451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059082-3ac6-4649-8f9f-4cf319a5c93a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.005070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 694/1369] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:37.010600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05b12-9506-430c-a99c-5642b00f20f4 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.011042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05b12-9506-430c-a99c-5642b00f20f4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.011162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05b12-9506-430c-a99c-5642b00f20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.028806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-24d05b12-9506-430c-a99c-5642b00f20f4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:37.030023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-24d05b12-9506-430c-a99c-5642b00f20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:37.038834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 676/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:37.082025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da059082-3ac6-4649-8f9f-4cf319a5c93a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:37.097066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da059082-3ac6-4649-8f9f-4cf319a5c93a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:37.102496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:37.103162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.103439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.103710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.112264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:37.113980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57040-4d0f-4dc5-bca9-8d8cf8bced78 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:37.123595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 695/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:37.397123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ba7e-4631-4a8b-b47f-8747e2464fd9 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.397344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ba7e-4631-4a8b-b47f-8747e2464fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.397624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ba7e-4631-4a8b-b47f-8747e2464fd9 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.399225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 677/1372] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:37.404882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004f4a-9187-4684-bfdc-af8960a1694a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.405360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004f4a-9187-4684-bfdc-af8960a1694a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.405819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004f4a-9187-4684-bfdc-af8960a1694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.425723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4e004f4a-9187-4684-bfdc-af8960a1694a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:37.426955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4e004f4a-9187-4684-bfdc-af8960a1694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:37.435321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 696/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:37.743976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27dd90-d9a3-4299-bc9e-9e4c6589f2d1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.744330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27dd90-d9a3-4299-bc9e-9e4c6589f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.744673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27dd90-d9a3-4299-bc9e-9e4c6589f2d1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.746281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 678/1374] 10.222.0.13 () {54 vars in 963 bytes} [Mon May 16 22:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:37.751233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19add66-9811-447d-9b70-71fb9740ccdd None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.751600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19add66-9811-447d-9b70-71fb9740ccdd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.751944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19add66-9811-447d-9b70-71fb9740ccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.802120 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a19add66-9811-447d-9b70-71fb9740ccdd None None] MFA Rules not processed for user `4e8bbada4fbb48a186e373ac378e1fda`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:37.803549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a19add66-9811-447d-9b70-71fb9740ccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:37.869343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 697/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Mon May 16 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:37.877865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27dd90-d9a3-4299-bc9e-9e4c6589f2d1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:37.888967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27dd90-d9a3-4299-bc9e-9e4c6589f2d1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:37.892748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:37.893414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:37.893695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:37.893964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:37.903294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:37.904749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4bd13-7f7b-42eb-845c-bb5de0cacb75 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:37.914563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 679/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:39.455974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a7b-2883-4851-807d-6fa508269a28 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:39.456555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a7b-2883-4851-807d-6fa508269a28 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:39.456555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe523a7b-2883-4851-807d-6fa508269a28 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:39.458042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 698/1377] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:39.464159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1cc17-61d2-44d1-8251-e8dffcb9cb3d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:39.464719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1cc17-61d2-44d1-8251-e8dffcb9cb3d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:39.464803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1cc17-61d2-44d1-8251-e8dffcb9cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:39.483624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2cb1cc17-61d2-44d1-8251-e8dffcb9cb3d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:39.484919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2cb1cc17-61d2-44d1-8251-e8dffcb9cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:39.493074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 680/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:39.538377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523a7b-2883-4851-807d-6fa508269a28 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:39.558781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe523a7b-2883-4851-807d-6fa508269a28 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:39.564874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70482266-01a3-445a-bba9-624956b60863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:39.565580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482266-01a3-445a-bba9-624956b60863 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:39.565867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482266-01a3-445a-bba9-624956b60863 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:39.566148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70482266-01a3-445a-bba9-624956b60863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:39.575563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482266-01a3-445a-bba9-624956b60863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:39.577226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70482266-01a3-445a-bba9-624956b60863 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:39.590115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 699/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:41.856742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e903b-6778-4a17-b159-66e3b03985b3 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:41.857433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e903b-6778-4a17-b159-66e3b03985b3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:41.857433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e903b-6778-4a17-b159-66e3b03985b3 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:41.858696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 681/1380] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:41.864574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216a35-3f1b-41cc-9ff5-16d5d7c31f97 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:41.865008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216a35-3f1b-41cc-9ff5-16d5d7c31f97 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:41.865133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216a35-3f1b-41cc-9ff5-16d5d7c31f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:41.884397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dc216a35-3f1b-41cc-9ff5-16d5d7c31f97 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:41.885706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dc216a35-3f1b-41cc-9ff5-16d5d7c31f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:41.894170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 700/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:41.940005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e903b-6778-4a17-b159-66e3b03985b3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:41.955412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e903b-6778-4a17-b159-66e3b03985b3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:41.960997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:41.961779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:41.962268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:41.962640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:41.971798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:41.973543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47ff3c-9226-4813-b086-c82d9d14c507 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:41.983108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 682/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:44.250844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a721e5-c971-463c-8b90-ab4b6b656c23 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:44.251489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a721e5-c971-463c-8b90-ab4b6b656c23 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:44.251489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a721e5-c971-463c-8b90-ab4b6b656c23 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:44.252940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 701/1383] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:44.258320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e239-00bd-4840-b828-1865306a3bd8 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:44.258781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e239-00bd-4840-b828-1865306a3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:44.258882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e239-00bd-4840-b828-1865306a3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:44.275873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3bf3e239-00bd-4840-b828-1865306a3bd8 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:44.277047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3bf3e239-00bd-4840-b828-1865306a3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:44.285576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 683/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:44.327839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a721e5-c971-463c-8b90-ab4b6b656c23 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:44.344387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a721e5-c971-463c-8b90-ab4b6b656c23 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:44.350816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:44.351507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:44.351793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:44.352173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:44.362916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:44.364587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96431317-f152-43bb-bdaa-7e03ed58001d service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:44.376736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 702/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:46.724426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28d4e-5e2d-4112-af37-ea7e48bee8da None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:46.725108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28d4e-5e2d-4112-af37-ea7e48bee8da None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:46.725108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e28d4e-5e2d-4112-af37-ea7e48bee8da None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:46.726360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 684/1386] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:46.731532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a69bd-08f4-4385-b180-235d7562b4e1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:46.731996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a69bd-08f4-4385-b180-235d7562b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:46.732173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a69bd-08f4-4385-b180-235d7562b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:46.750581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ba5a69bd-08f4-4385-b180-235d7562b4e1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:46.751730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ba5a69bd-08f4-4385-b180-235d7562b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:46.759904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 703/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:46.803773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28d4e-5e2d-4112-af37-ea7e48bee8da None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:46.822377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e28d4e-5e2d-4112-af37-ea7e48bee8da None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:46.829505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:46.830160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:46.830459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:46.830746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:46.840362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:46.842038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d60e1-6fdb-4c9e-a43d-0b82b2f68090 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:46.851815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 685/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:49.131258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b226-2b32-45fa-8f71-df5a8446026a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:49.132048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b226-2b32-45fa-8f71-df5a8446026a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:49.132168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b226-2b32-45fa-8f71-df5a8446026a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:49.133595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 704/1389] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:49.139237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977e0e-6806-4d3f-85c2-ea949e468894 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:49.139642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977e0e-6806-4d3f-85c2-ea949e468894 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:49.140028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35977e0e-6806-4d3f-85c2-ea949e468894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:49.171806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-35977e0e-6806-4d3f-85c2-ea949e468894 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:49.173502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-35977e0e-6806-4d3f-85c2-ea949e468894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:49.183529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 686/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:11:49.243406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b226-2b32-45fa-8f71-df5a8446026a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:49.258911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b226-2b32-45fa-8f71-df5a8446026a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:49.264385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:49.265042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:49.265853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:49.266133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:49.274406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:49.275990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e313-c2ea-4e8e-96d3-01b70802e613 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:49.286005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 705/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:51.652135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda00b0-70d2-49c1-9931-172cf59e3c15 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:51.652775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda00b0-70d2-49c1-9931-172cf59e3c15 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:51.652775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda00b0-70d2-49c1-9931-172cf59e3c15 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:51.654159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 687/1392] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:51.659984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e4de-223d-4974-b37a-ca8d2717dcf9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:51.660429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e4de-223d-4974-b37a-ca8d2717dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:51.660539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e4de-223d-4974-b37a-ca8d2717dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:51.680623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2793e4de-223d-4974-b37a-ca8d2717dcf9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:51.681848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2793e4de-223d-4974-b37a-ca8d2717dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:51.690513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 706/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:51.738076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda00b0-70d2-49c1-9931-172cf59e3c15 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:51.752299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda00b0-70d2-49c1-9931-172cf59e3c15 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:51.758171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:51.758813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:51.759098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:51.759374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:51.767718 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:51.769346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815984c-5a39-4764-9551-e8a67df996b6 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:51.778805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 688/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:53.539052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388a97-abc2-48c5-9e69-c7817e64ef0e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:53.539625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388a97-abc2-48c5-9e69-c7817e64ef0e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:53.539625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388a97-abc2-48c5-9e69-c7817e64ef0e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:53.541167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 707/1395] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:53.546748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e61e-bed1-463d-b546-0f18e259097c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:53.546748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e61e-bed1-463d-b546-0f18e259097c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:53.547310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e61e-bed1-463d-b546-0f18e259097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:53.569690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f9a5e61e-bed1-463d-b546-0f18e259097c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:53.570884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f9a5e61e-bed1-463d-b546-0f18e259097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:53.579535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 689/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:53.636763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9423d-bcc6-4f3a-a76d-6e371b3c296a None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:53.637049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9423d-bcc6-4f3a-a76d-6e371b3c296a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:53.637368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9423d-bcc6-4f3a-a76d-6e371b3c296a None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:53.638725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 708/1397] 10.222.0.13 () {54 vars in 962 bytes} [Mon May 16 22:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:53.643596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262dd7-725e-4ae2-8ccf-70632c2b8e35 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:53.643884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262dd7-725e-4ae2-8ccf-70632c2b8e35 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:53.644158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de262dd7-725e-4ae2-8ccf-70632c2b8e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:53.690955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-de262dd7-725e-4ae2-8ccf-70632c2b8e35 None None] MFA Rules not processed for user `fa8d29f2955b4edaa93ecdd798ea4f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:53.692132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-de262dd7-725e-4ae2-8ccf-70632c2b8e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:53.747770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 690/1398] 10.222.0.13 () {58 vars in 1059 bytes} [Mon May 16 22:11:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:53.755707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9423d-bcc6-4f3a-a76d-6e371b3c296a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:53.766956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9423d-bcc6-4f3a-a76d-6e371b3c296a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:53.770599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:53.771249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:53.771530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:53.771802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:53.780469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:53.781950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab9431-eb8e-4224-b1c7-071c8db9141a service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:53.791083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 709/1399] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:54.015152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dff50-7c47-461a-9dd4-e38d04a6f9e4 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.015451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dff50-7c47-461a-9dd4-e38d04a6f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.015759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6dff50-7c47-461a-9dd4-e38d04a6f9e4 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.017133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 691/1400] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:54.023820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1b51-a153-4aab-9de1-9949474ebb5f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.024115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1b51-a153-4aab-9de1-9949474ebb5f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.024395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a1b51-a153-4aab-9de1-9949474ebb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.042394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-be6a1b51-a153-4aab-9de1-9949474ebb5f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:54.043494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-be6a1b51-a153-4aab-9de1-9949474ebb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:54.052209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 710/1401] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:54.095586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dff50-7c47-461a-9dd4-e38d04a6f9e4 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:54.110804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6dff50-7c47-461a-9dd4-e38d04a6f9e4 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:54.116488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:54.117373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.117658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.117936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.126371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:54.127946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c6353-c04e-4a63-80dd-a88c5b6c31a5 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:54.137408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 692/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:11:54.247362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d17cb-cf3d-460d-a6a7-4934d1e7dfbf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.247798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d17cb-cf3d-460d-a6a7-4934d1e7dfbf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.248181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d17cb-cf3d-460d-a6a7-4934d1e7dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.302468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0d4d17cb-cf3d-460d-a6a7-4934d1e7dfbf None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:54.303603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0d4d17cb-cf3d-460d-a6a7-4934d1e7dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:54.369050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 711/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:54.414553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d81b-9255-459f-8961-9b57b73457c2 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.414866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d81b-9255-459f-8961-9b57b73457c2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.415121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4d81b-9255-459f-8961-9b57b73457c2 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.416532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 693/1404] 10.222.0.13 () {54 vars in 942 bytes} [Mon May 16 22:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:54.422871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28947-006c-47e1-978b-4c95b8c82337 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.423166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28947-006c-47e1-978b-4c95b8c82337 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.423459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c28947-006c-47e1-978b-4c95b8c82337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.470213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-05c28947-006c-47e1-978b-4c95b8c82337 None None] MFA Rules not processed for user `d51afc0a8e1949fb8d3e346a97c56ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:54.471397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-05c28947-006c-47e1-978b-4c95b8c82337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:54.539723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 712/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Mon May 16 22:11:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:11:54.549144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4d81b-9255-459f-8961-9b57b73457c2 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:54.562894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4d81b-9255-459f-8961-9b57b73457c2 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:54.567778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:54.568422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:54.568704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:54.568980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:54.578213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:54.579745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9d11b-b72a-44cc-94e8-ef3b329d5121 service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:54.588028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 694/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:11:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:11:56.444366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a77-fb23-47bf-b43d-b4f46ad94ae7 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:56.444936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a77-fb23-47bf-b43d-b4f46ad94ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:56.444936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be3a77-fb23-47bf-b43d-b4f46ad94ae7 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:56.451543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891799-18ce-47c7-9935-24ab6e79ddf0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:56.451947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891799-18ce-47c7-9935-24ab6e79ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:56.452098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34891799-18ce-47c7-9935-24ab6e79ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:56.453448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 713/1407] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:11:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:11:56.470792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-34891799-18ce-47c7-9935-24ab6e79ddf0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:11:56.472005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-34891799-18ce-47c7-9935-24ab6e79ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:11:56.482309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 695/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:11:56.526519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be3a77-fb23-47bf-b43d-b4f46ad94ae7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:11:56.542891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be3a77-fb23-47bf-b43d-b4f46ad94ae7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:11:56.549700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:11:56.550483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:11:56.550777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:11:56.551059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:11:56.560288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:11:56.562018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee592c-a830-40ad-b2be-8c4acb1ae644 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:11:56.571884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 714/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:17.553907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7299-b80d-4b7c-a0c4-1eda7229b137 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:17.554366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7299-b80d-4b7c-a0c4-1eda7229b137 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:17.554455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7299-b80d-4b7c-a0c4-1eda7229b137 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:17.555805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 696/1410] 10.222.0.13 () {54 vars in 918 bytes} [Mon May 16 22:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:17.562083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047639-6f30-4a04-add0-56b8beabf3c1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:17.562524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047639-6f30-4a04-add0-56b8beabf3c1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:17.562673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047639-6f30-4a04-add0-56b8beabf3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:17.580817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9f047639-6f30-4a04-add0-56b8beabf3c1 None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:17.582041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9f047639-6f30-4a04-add0-56b8beabf3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:17.590446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 715/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Mon May 16 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:17.604349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2e67-4979-4074-a188-ddd0caa479ca None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:17.604660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2e67-4979-4074-a188-ddd0caa479ca None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:17.604959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2e67-4979-4074-a188-ddd0caa479ca None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:17.606327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 697/1412] 10.222.0.13 () {54 vars in 918 bytes} [Mon May 16 22:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:17.611224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fe90-782c-4b4b-b954-55c1386bbc6f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:17.611510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fe90-782c-4b4b-b954-55c1386bbc6f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:17.611787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982fe90-782c-4b4b-b954-55c1386bbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:17.629444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6982fe90-782c-4b4b-b954-55c1386bbc6f None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:17.630617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6982fe90-782c-4b4b-b954-55c1386bbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:17.640272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 716/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Mon May 16 22:12:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:20.339630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7adf3-4351-44a4-8d7d-d3b68cbc4bb7 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:20.340203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7adf3-4351-44a4-8d7d-d3b68cbc4bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:20.340203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7adf3-4351-44a4-8d7d-d3b68cbc4bb7 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:20.341569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:20.346956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c947-f027-4767-8c9a-500e0660a44a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:20.347396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c947-f027-4767-8c9a-500e0660a44a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:20.347501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c947-f027-4767-8c9a-500e0660a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:20.365665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ba80c947-f027-4767-8c9a-500e0660a44a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:20.366855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ba80c947-f027-4767-8c9a-500e0660a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:20.375069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:20.416044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7adf3-4351-44a4-8d7d-d3b68cbc4bb7 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:20.430044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7adf3-4351-44a4-8d7d-d3b68cbc4bb7 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:20.435432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:20.436063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:20.436865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:20.437142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:20.445380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:20.446961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec795-7d9e-4656-9993-e78f3cfcda15 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:20.456684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 699/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:21.439751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852f37-c514-4077-91ff-ef137779854e None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:21.440317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852f37-c514-4077-91ff-ef137779854e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:21.440317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40852f37-c514-4077-91ff-ef137779854e None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:21.441727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:21.446584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583b31-295f-47e5-9444-a48518e49f1e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:21.447012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583b31-295f-47e5-9444-a48518e49f1e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:21.447124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94583b31-295f-47e5-9444-a48518e49f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:21.464888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-94583b31-295f-47e5-9444-a48518e49f1e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:21.466121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-94583b31-295f-47e5-9444-a48518e49f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:21.474371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:21.623221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40852f37-c514-4077-91ff-ef137779854e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:21.637693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40852f37-c514-4077-91ff-ef137779854e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:21.643574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:21.644209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:21.644492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:21.644769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:21.652726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:21.654341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315ac21-2267-400b-ab5d-d6bb48737918 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:21.664597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 719/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:22.601570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992853-5150-48d1-9a68-b18c64e4513c None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:22.602158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992853-5150-48d1-9a68-b18c64e4513c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:22.602158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0992853-5150-48d1-9a68-b18c64e4513c None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:22.603464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:22.608925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83c23-6072-41a2-86b9-2ac46e00a61d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:22.609324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83c23-6072-41a2-86b9-2ac46e00a61d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:22.609549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a83c23-6072-41a2-86b9-2ac46e00a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:22.627116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c9a83c23-6072-41a2-86b9-2ac46e00a61d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:22.628296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c9a83c23-6072-41a2-86b9-2ac46e00a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:22.636224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:22.783449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992853-5150-48d1-9a68-b18c64e4513c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:22.798034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0992853-5150-48d1-9a68-b18c64e4513c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:22.803303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:22.803937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:22.804216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:22.804487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:22.812434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:22.814041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85269a-7789-4cfa-b2ed-f271b80bbb79 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:22.823031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 702/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:23.739434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318704ad-18dd-4cba-8876-9a5397e15ea9 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:23.739997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318704ad-18dd-4cba-8876-9a5397e15ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:23.739997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318704ad-18dd-4cba-8876-9a5397e15ea9 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:23.741412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:23.746295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70c4d-330b-4c82-ae84-a0a877adf2d1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:23.746678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70c4d-330b-4c82-ae84-a0a877adf2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:23.746821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70c4d-330b-4c82-ae84-a0a877adf2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:23.764900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dcb70c4d-330b-4c82-ae84-a0a877adf2d1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:23.766113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dcb70c4d-330b-4c82-ae84-a0a877adf2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:23.773731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:23.923839 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318704ad-18dd-4cba-8876-9a5397e15ea9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:23.939170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318704ad-18dd-4cba-8876-9a5397e15ea9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:23.944536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:23.945165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:23.945474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:23.945748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:23.954318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:23.955915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f48e9d-1c7e-45d5-a9f6-f1888b968835 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:23.965045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 722/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:24.883885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf909ec-d705-4069-bd4d-e355f54b4a17 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:24.884399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf909ec-d705-4069-bd4d-e355f54b4a17 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:24.884508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf909ec-d705-4069-bd4d-e355f54b4a17 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:24.885805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:12:24.891367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef667d-5c3a-45a1-9abe-8a05c5b5cb5d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:24.891790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef667d-5c3a-45a1-9abe-8a05c5b5cb5d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:24.891930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef667d-5c3a-45a1-9abe-8a05c5b5cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:24.909325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a2ef667d-5c3a-45a1-9abe-8a05c5b5cb5d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:24.910523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a2ef667d-5c3a-45a1-9abe-8a05c5b5cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:24.918336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:25.090252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf909ec-d705-4069-bd4d-e355f54b4a17 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:25.104158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf909ec-d705-4069-bd4d-e355f54b4a17 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:25.110242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:25.110876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:25.111155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:25.111423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:25.119474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:25.121046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78afad-a1ef-414a-8b75-16159dd82c0f service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:25.130667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 705/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:25.994205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f5a11-b222-4d33-93ad-7a1d6cd5aeed None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:25.994789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f5a11-b222-4d33-93ad-7a1d6cd5aeed None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:25.994789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f5a11-b222-4d33-93ad-7a1d6cd5aeed None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:25.996151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:26.001135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f71a4-f0e2-4edb-bdfe-cc6791f98774 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:26.001584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f71a4-f0e2-4edb-bdfe-cc6791f98774 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:26.001749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f71a4-f0e2-4edb-bdfe-cc6791f98774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:26.019950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f10f71a4-f0e2-4edb-bdfe-cc6791f98774 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:26.021146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f10f71a4-f0e2-4edb-bdfe-cc6791f98774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:26.028846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:26.178943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f5a11-b222-4d33-93ad-7a1d6cd5aeed None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:26.193288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f5a11-b222-4d33-93ad-7a1d6cd5aeed None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:26.198592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:26.199213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:26.199493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:26.199763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:26.208156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:26.209768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83310a78-fda0-4655-95e3-6c8a58ef5a7f service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:26.218710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 725/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:27.086556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c0e4-d9ba-4394-ab2e-6dc17b52ca98 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:27.087083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c0e4-d9ba-4394-ab2e-6dc17b52ca98 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:27.087083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118c0e4-d9ba-4394-ab2e-6dc17b52ca98 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:27.088379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:27.093891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf00ae-6cba-48d1-af98-5b4d4488db35 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:27.094297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf00ae-6cba-48d1-af98-5b4d4488db35 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:27.094443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf00ae-6cba-48d1-af98-5b4d4488db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:27.112410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cdbf00ae-6cba-48d1-af98-5b4d4488db35 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:27.113626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cdbf00ae-6cba-48d1-af98-5b4d4488db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:27.121425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:27.270768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c0e4-d9ba-4394-ab2e-6dc17b52ca98 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:27.285378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118c0e4-d9ba-4394-ab2e-6dc17b52ca98 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:27.290702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:27.291358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:27.291643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:27.291919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:27.300321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:27.301943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e8f0e-8132-42f3-91dd-deb693f0cd67 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:27.311168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 708/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:28.167428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a3d9-c88c-41db-9e4f-8c42431f61c4 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:28.167969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a3d9-c88c-41db-9e4f-8c42431f61c4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:28.167969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60a3d9-c88c-41db-9e4f-8c42431f61c4 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:28.169379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:28.174843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b179-db40-4850-b998-0f1f2cd518d3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:28.175221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b179-db40-4850-b998-0f1f2cd518d3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:28.175404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8b179-db40-4850-b998-0f1f2cd518d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:28.193349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-23e8b179-db40-4850-b998-0f1f2cd518d3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:28.194533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-23e8b179-db40-4850-b998-0f1f2cd518d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:28.202219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:28.349629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a3d9-c88c-41db-9e4f-8c42431f61c4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:28.364191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60a3d9-c88c-41db-9e4f-8c42431f61c4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:28.369614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:28.370240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:28.370520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:28.370793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:28.379175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:28.380756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c138d08-22cd-47d4-a99a-8c31a16f7033 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:28.390404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 728/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:29.252696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4736ff-bbc4-4871-b6ec-e93b14501063 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:29.253242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4736ff-bbc4-4871-b6ec-e93b14501063 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:29.253342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4736ff-bbc4-4871-b6ec-e93b14501063 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:29.254621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:29.259762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d5ff-d4aa-4afc-a699-370f2cd3e6af None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:29.260181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d5ff-d4aa-4afc-a699-370f2cd3e6af None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:29.260316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4d5ff-d4aa-4afc-a699-370f2cd3e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:29.277887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c2e4d5ff-d4aa-4afc-a699-370f2cd3e6af None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:29.279093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c2e4d5ff-d4aa-4afc-a699-370f2cd3e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:29.287258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:29.434597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4736ff-bbc4-4871-b6ec-e93b14501063 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:29.448528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4736ff-bbc4-4871-b6ec-e93b14501063 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:29.453871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:29.454501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:29.454784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:29.455059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:29.462979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:29.464548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ade0c-51cd-45d7-8852-73bc70602710 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:29.474161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 711/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:31.570517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56b9c5-da45-4a86-83f9-efe5565e296f None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:31.570925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56b9c5-da45-4a86-83f9-efe5565e296f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:31.571068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56b9c5-da45-4a86-83f9-efe5565e296f None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:31.572464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:31.578519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9ac4-a141-492e-90dc-f83b54c767d7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:31.578904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9ac4-a141-492e-90dc-f83b54c767d7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:31.579059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9ac4-a141-492e-90dc-f83b54c767d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:31.595920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-cb9e9ac4-a141-492e-90dc-f83b54c767d7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:31.597095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cb9e9ac4-a141-492e-90dc-f83b54c767d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:31.604640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:31.645095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56b9c5-da45-4a86-83f9-efe5565e296f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:31.655528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56b9c5-da45-4a86-83f9-efe5565e296f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:31.659017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:31.659647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:31.659930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:31.660203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:31.668898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:31.670366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d380d24-1848-4e51-90eb-0b24f6bce84a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:31.679496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 731/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:34.099404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746576-1969-4740-a624-eecafe81a822 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:34.099980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746576-1969-4740-a624-eecafe81a822 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:34.099980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5746576-1969-4740-a624-eecafe81a822 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:34.101346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:34.106646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65a08-d731-45a4-9ea1-315752fbb0b2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:34.107024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65a08-d731-45a4-9ea1-315752fbb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:34.107210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a65a08-d731-45a4-9ea1-315752fbb0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:34.124275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d4a65a08-d731-45a4-9ea1-315752fbb0b2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:34.125498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d4a65a08-d731-45a4-9ea1-315752fbb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:34.133460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:34.170928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5746576-1969-4740-a624-eecafe81a822 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:34.181195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5746576-1969-4740-a624-eecafe81a822 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:34.184629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:34.185276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:34.185561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:34.185833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:34.194471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:34.195881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec1147-8453-4b07-8784-4061ac080dad service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:34.205411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 714/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:36.688281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:36.688851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:36.688851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:36.690225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:36.695438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ff14-741d-445d-af5e-9652ccc9b500 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:36.695856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ff14-741d-445d-af5e-9652ccc9b500 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:36.695994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ff14-741d-445d-af5e-9652ccc9b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:36.712935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ff21ff14-741d-445d-af5e-9652ccc9b500 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:36.714155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ff21ff14-741d-445d-af5e-9652ccc9b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:36.722281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:36.760525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:36.762180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:36.774728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391447af-5e2f-433c-ab8f-c0ec9c971179 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:36.778188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:36.778808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:36.779087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:36.779361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:36.788666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:36.790108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120f43-4b22-42cc-a4fe-45b164eb0edf service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:36.799823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 734/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:39.121561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd001-4ba4-4469-8724-fa8e6a13d745 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:39.122119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd001-4ba4-4469-8724-fa8e6a13d745 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:39.122119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfd001-4ba4-4469-8724-fa8e6a13d745 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:39.123450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:39.128817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58bfe-9bab-4336-a3eb-1bfbc3468160 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:39.129254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58bfe-9bab-4336-a3eb-1bfbc3468160 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:39.129466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58bfe-9bab-4336-a3eb-1bfbc3468160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:39.146684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-78b58bfe-9bab-4336-a3eb-1bfbc3468160 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:39.147861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-78b58bfe-9bab-4336-a3eb-1bfbc3468160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:39.156024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:39.193086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfd001-4ba4-4469-8724-fa8e6a13d745 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:39.203455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfd001-4ba4-4469-8724-fa8e6a13d745 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:39.206872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:39.207491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:39.207773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:39.208041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:39.216740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:39.218740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aee0ca-43b3-48ec-8bb8-b20698c68f86 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:39.227996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 717/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:41.486232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020734c-20b9-4609-9e8c-ccc9753c27f8 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:41.486808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020734c-20b9-4609-9e8c-ccc9753c27f8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:41.486808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020734c-20b9-4609-9e8c-ccc9753c27f8 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:41.488144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:41.493456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddedf0-c9a6-4817-af8d-04da89452d1f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:41.493854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddedf0-c9a6-4817-af8d-04da89452d1f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:41.494023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddedf0-c9a6-4817-af8d-04da89452d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:41.511861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0eddedf0-c9a6-4817-af8d-04da89452d1f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:41.513052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0eddedf0-c9a6-4817-af8d-04da89452d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:41.521412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:41.558626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020734c-20b9-4609-9e8c-ccc9753c27f8 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:41.569810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020734c-20b9-4609-9e8c-ccc9753c27f8 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:41.573324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:41.573958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:41.574243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:41.574519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:41.583331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:41.584760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd70f9-062b-42f1-a309-8eeae2d0d181 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:41.595300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 737/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:43.868887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877116f-283d-460c-98e9-bf42f78f2e42 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:43.869437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877116f-283d-460c-98e9-bf42f78f2e42 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:43.869437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877116f-283d-460c-98e9-bf42f78f2e42 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:43.870732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:43.876545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1dfe-5abc-4942-96d8-4bbe3941ba92 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:43.876957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1dfe-5abc-4942-96d8-4bbe3941ba92 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:43.877107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f1dfe-5abc-4942-96d8-4bbe3941ba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:43.894478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-534f1dfe-5abc-4942-96d8-4bbe3941ba92 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:43.895657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-534f1dfe-5abc-4942-96d8-4bbe3941ba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:43.903351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:43.940688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877116f-283d-460c-98e9-bf42f78f2e42 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:43.951312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877116f-283d-460c-98e9-bf42f78f2e42 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:43.954837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:43.955468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:43.955750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:43.956022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:43.964714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:43.966162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896380be-add3-4602-bbfb-6edaeeebdbab service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:43.975271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 720/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:46.244715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad05a3-09e7-40e6-8410-4613974c38d2 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:46.245304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad05a3-09e7-40e6-8410-4613974c38d2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:46.245304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad05a3-09e7-40e6-8410-4613974c38d2 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:46.246659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:46.251891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fafa-cb57-4f7d-ac1a-65167c990670 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:46.252320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fafa-cb57-4f7d-ac1a-65167c990670 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:46.252454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52fafa-cb57-4f7d-ac1a-65167c990670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:46.270941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0f52fafa-cb57-4f7d-ac1a-65167c990670 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:46.272118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0f52fafa-cb57-4f7d-ac1a-65167c990670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:46.279832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:46.316473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad05a3-09e7-40e6-8410-4613974c38d2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:46.326764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad05a3-09e7-40e6-8410-4613974c38d2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:46.330790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:46.331411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:46.331687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:46.331958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:46.340560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:46.342017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ea27-bbab-4954-9664-be354225d5b5 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:46.351640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 740/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:48.580379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57f-213a-4d9a-b46b-42b1ff30485b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:48.580934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57f-213a-4d9a-b46b-42b1ff30485b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:48.580934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c57f-213a-4d9a-b46b-42b1ff30485b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:48.582313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:48.587718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f216-4a1f-4b99-8cd3-ccac39f2e3cc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:48.588138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f216-4a1f-4b99-8cd3-ccac39f2e3cc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:48.588276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f216-4a1f-4b99-8cd3-ccac39f2e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:48.606461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-09e8f216-4a1f-4b99-8cd3-ccac39f2e3cc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:48.607664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-09e8f216-4a1f-4b99-8cd3-ccac39f2e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:48.615401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:48.652321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c57f-213a-4d9a-b46b-42b1ff30485b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:48.663520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c57f-213a-4d9a-b46b-42b1ff30485b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:48.667074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:48.667708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:48.667992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:48.668296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:48.677192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:48.678631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c45eb-b252-446f-ba6b-0e8b661ccf16 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:48.688246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 723/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:50.929448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20166d8a-8954-40f6-a01d-b554dceed9b1 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:50.930039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20166d8a-8954-40f6-a01d-b554dceed9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:50.930039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20166d8a-8954-40f6-a01d-b554dceed9b1 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:50.931411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:50.937865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f296-e4a0-4376-a456-33a35e97cb59 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:50.938353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f296-e4a0-4376-a456-33a35e97cb59 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:50.938459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f296-e4a0-4376-a456-33a35e97cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:50.957129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b626f296-e4a0-4376-a456-33a35e97cb59 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:50.958354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b626f296-e4a0-4376-a456-33a35e97cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:50.966091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:51.002792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20166d8a-8954-40f6-a01d-b554dceed9b1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:51.013482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20166d8a-8954-40f6-a01d-b554dceed9b1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:51.017218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:51.017855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:51.018140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:51.018415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:51.027375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:51.028807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25367d-cdff-4bf4-ace4-f08134084ed5 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:51.038794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 743/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:12:53.252976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aeae1-1f41-4810-9356-d718ca58afda None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:53.253556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aeae1-1f41-4810-9356-d718ca58afda None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:53.253556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aeae1-1f41-4810-9356-d718ca58afda None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:53.254921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:12:53.260389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350fa96-7f3c-4a79-ac35-4b79443b6fda None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:53.260798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350fa96-7f3c-4a79-ac35-4b79443b6fda None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:53.260953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350fa96-7f3c-4a79-ac35-4b79443b6fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:53.278601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9350fa96-7f3c-4a79-ac35-4b79443b6fda None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:12:53.279780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9350fa96-7f3c-4a79-ac35-4b79443b6fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:12:53.287458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:12:53.322632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aeae1-1f41-4810-9356-d718ca58afda None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:12:53.333601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aeae1-1f41-4810-9356-d718ca58afda None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:12:53.337069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:12:53.337721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:12:53.338003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:12:53.338275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:12:53.346884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:12:53.348298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61c316-543e-4166-a147-0ba7f2d960b8 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:12:53.357370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 726/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:26.460053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c23af-7b89-4579-8720-7be758532c21 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:26.460679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c23af-7b89-4579-8720-7be758532c21 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:26.460679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c23af-7b89-4579-8720-7be758532c21 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:26.462017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 745/1471] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:26.467546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a89e34-10d3-49a2-bd5a-b146f682983b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:26.468021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a89e34-10d3-49a2-bd5a-b146f682983b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:26.468163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a89e34-10d3-49a2-bd5a-b146f682983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:26.489297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-59a89e34-10d3-49a2-bd5a-b146f682983b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:26.490523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-59a89e34-10d3-49a2-bd5a-b146f682983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:26.498448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 727/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:26.544729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa80eb-38d9-45d4-8d79-326b00df139c None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:26.545630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa80eb-38d9-45d4-8d79-326b00df139c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:26.545897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa80eb-38d9-45d4-8d79-326b00df139c None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:26.547288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 746/1473] 10.222.0.13 () {54 vars in 962 bytes} [Mon May 16 22:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:26.552103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56f1e-2732-40a0-96a8-482e3c8431fd None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:26.552388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56f1e-2732-40a0-96a8-482e3c8431fd None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:26.552663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d56f1e-2732-40a0-96a8-482e3c8431fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:26.569934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-11d56f1e-2732-40a0-96a8-482e3c8431fd None None] MFA Rules not processed for user `fa8d29f2955b4edaa93ecdd798ea4f62`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:26.571102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-11d56f1e-2732-40a0-96a8-482e3c8431fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:26.577972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 728/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Mon May 16 22:13:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:26.584954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa80eb-38d9-45d4-8d79-326b00df139c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:26.596047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa80eb-38d9-45d4-8d79-326b00df139c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:26.599594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:26.600209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:26.600492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:26.600766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:26.609502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:26.610934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5665dc-ec14-43c0-a0ac-c05588365b85 service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:26.620078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 747/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:28.922797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac7ff-53d3-4ad4-a6f0-047db6f9f835 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:28.923360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac7ff-53d3-4ad4-a6f0-047db6f9f835 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:28.923360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac7ff-53d3-4ad4-a6f0-047db6f9f835 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:28.924681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 729/1476] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:28.929824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d512d-fc5a-4704-af88-d2f7a929fb2b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:28.930188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d512d-fc5a-4704-af88-d2f7a929fb2b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:28.930419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d512d-fc5a-4704-af88-d2f7a929fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:28.948715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8f0d512d-fc5a-4704-af88-d2f7a929fb2b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:28.950071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8f0d512d-fc5a-4704-af88-d2f7a929fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:28.959526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 748/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:28.982676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac7ff-53d3-4ad4-a6f0-047db6f9f835 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:28.994684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac7ff-53d3-4ad4-a6f0-047db6f9f835 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:28.999061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:28.999698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:28.999979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:29.000252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:29.000976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:29.002737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:13:29.002737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:13:29.002737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:13:29.003881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8d964-acc9-45bc-a6d0-cec16c499324 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:29.022891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 730/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Mon May 16 22:13:28 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:13:31.293708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf763e-a294-4c9e-bd58-b6ba919c8205 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:31.294253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf763e-a294-4c9e-bd58-b6ba919c8205 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:31.294253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf763e-a294-4c9e-bd58-b6ba919c8205 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:31.296141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 749/1479] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:31.301875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e974-14da-4467-8bde-93970f4eea37 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:31.302276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e974-14da-4467-8bde-93970f4eea37 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:31.302437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e974-14da-4467-8bde-93970f4eea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:31.320374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2d32e974-14da-4467-8bde-93970f4eea37 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:31.321615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2d32e974-14da-4467-8bde-93970f4eea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:31.329325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 731/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:13:31.370518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf763e-a294-4c9e-bd58-b6ba919c8205 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:31.385100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf763e-a294-4c9e-bd58-b6ba919c8205 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:31.390550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:31.391175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:31.391455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:31.391749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:31.399553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:31.401112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b1610-4009-4a12-93d5-06af6054a7b3 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:31.410616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 750/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:33.751800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f51003-5604-4c65-926e-9baf7e6bc46c None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:33.752376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f51003-5604-4c65-926e-9baf7e6bc46c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:33.752376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f51003-5604-4c65-926e-9baf7e6bc46c None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:33.753745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 732/1482] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:33.759080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3b8c-454c-41f3-af99-05f4734d4576 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:33.759462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3b8c-454c-41f3-af99-05f4734d4576 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:33.759633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3b8c-454c-41f3-af99-05f4734d4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:33.776653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b40a3b8c-454c-41f3-af99-05f4734d4576 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:33.777852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b40a3b8c-454c-41f3-af99-05f4734d4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:33.785962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 751/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:33.822162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f51003-5604-4c65-926e-9baf7e6bc46c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:33.832638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f51003-5604-4c65-926e-9baf7e6bc46c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:33.836096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:33.836723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:33.837004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:33.837302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:33.846475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:33.847834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62a54a-12ba-4587-bd0e-7c5a949edf56 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:33.856861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 733/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:36.126789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f7ec-7651-4706-b3a8-cf15efb4a4f0 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:36.127318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f7ec-7651-4706-b3a8-cf15efb4a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:36.127318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f7ec-7651-4706-b3a8-cf15efb4a4f0 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:36.128608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 752/1485] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:36.134174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b453b2-58cf-45db-9051-4dab96d8e36e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:36.134617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b453b2-58cf-45db-9051-4dab96d8e36e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:36.134753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b453b2-58cf-45db-9051-4dab96d8e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:36.152031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-52b453b2-58cf-45db-9051-4dab96d8e36e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:36.153231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-52b453b2-58cf-45db-9051-4dab96d8e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:36.161371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 734/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:36.198660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f7ec-7651-4706-b3a8-cf15efb4a4f0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:36.208949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f7ec-7651-4706-b3a8-cf15efb4a4f0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:36.212427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:36.213051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:36.213369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:36.213644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:36.223338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:36.224772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9af6d-cd53-45f2-afc8-de8e3869fdbc service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:36.234525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 753/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:38.529988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc421b8-5777-4fda-b41a-ec178cf5dcb1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:38.530556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc421b8-5777-4fda-b41a-ec178cf5dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:38.530556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc421b8-5777-4fda-b41a-ec178cf5dcb1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:38.531947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 735/1488] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:38.537145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85309b-5b25-47ee-89a0-46827b0354f2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:38.537611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85309b-5b25-47ee-89a0-46827b0354f2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:38.537722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85309b-5b25-47ee-89a0-46827b0354f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:38.556228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-aa85309b-5b25-47ee-89a0-46827b0354f2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:38.557460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-aa85309b-5b25-47ee-89a0-46827b0354f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:38.565168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 754/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:38.605326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc421b8-5777-4fda-b41a-ec178cf5dcb1 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:38.615802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc421b8-5777-4fda-b41a-ec178cf5dcb1 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:38.619365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:38.619992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:38.620274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:38.620548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:38.629181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:38.630635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab8739-26a2-497a-8069-b06ce9e8b714 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:38.640454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 736/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:13:40.994476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eb279-d1f1-43f6-a81b-cda03b394c85 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:40.995095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eb279-d1f1-43f6-a81b-cda03b394c85 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:40.995095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eb279-d1f1-43f6-a81b-cda03b394c85 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:40.996432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 755/1491] 10.222.0.13 () {54 vars in 926 bytes} [Mon May 16 22:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:13:41.002400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849ed8-9936-4915-a367-ba2f85a09699 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:41.002804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849ed8-9936-4915-a367-ba2f85a09699 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:41.002962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13849ed8-9936-4915-a367-ba2f85a09699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:41.020315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-13849ed8-9936-4915-a367-ba2f85a09699 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:13:41.021539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-13849ed8-9936-4915-a367-ba2f85a09699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:13:41.029294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 737/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon May 16 22:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:13:41.067357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eb279-d1f1-43f6-a81b-cda03b394c85 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:13:41.079754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eb279-d1f1-43f6-a81b-cda03b394c85 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:13:41.083400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:13:41.084067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:13:41.084374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:13:41.084644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:13:41.098546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:13:41.100193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2c7e-c26a-4949-b40d-6affd2edeaab service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:13:41.111055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 756/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:15:27.255602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.256165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.256165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.274352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:15:27.275522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:27.283709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 738/1494] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:15:27.292509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.293007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.293111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.310635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:15:27.311843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:27.319514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 757/1495] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:15:27.323920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.333889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb1874-fb52-4ba1-b532-b80c3b6292e0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.338314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.338964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.339246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.339521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.340917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:15:27.341257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.342252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.342252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:15:27.342252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:15:27.343130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.354114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 739/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:15:27.361913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.370856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492ac0-3389-4387-b50f-b78b49fee9ee None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.375412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.376056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.376339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.376612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.377341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.379100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.379100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:15:27.379100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:15:27.380327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.417664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 758/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:15:27.421757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.431375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811a88a-76fd-4605-96bd-008bb01afd76 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.484759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.485451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.485736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.486033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.486720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.487755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.487755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:15:27.487755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:15:27.488955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.507354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 740/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:15:27.511628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.521957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089f22-b37d-4732-8797-b37c903ea7e0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.526447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.527097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.527381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.528252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.528973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.530028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.530028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:15:27.530028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:15:27.530914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.543135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 759/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:15:27.547002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.556373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783b69d-006e-481d-950e-e6af4de2c25b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.560955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.561647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.561941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.562294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.562989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.563975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.563975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:15:27.563975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:15:27.564859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97049ae3-fc29-44ba-9ea2-cec8692269ca admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.578105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 741/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:15:27.582042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.592322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cfe70-1abd-4c03-81ec-b630c181e394 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.596772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.597664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.597943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.598215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] PATH_INFO: `/v3/projects/bd9a974d4935487f9f74aa8efe217b5c/users/4af43af4621e4400b481d3de28aa78a1/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.611981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9a974d4935487f9f74aa8efe217b5c, user_id=4af43af4621e4400b481d3de28aa78a1, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.613003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.613003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:15:27.613003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:15:27.614970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aec7a-b26c-465f-8553-f60e099a70ef admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.627592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 760/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:15:27 2022] PUT /identity/v3/projects/bd9a974d4935487f9f74aa8efe217b5c/users/4af43af4621e4400b481d3de28aa78a1/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:15:27.639449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0e810-1b97-4901-806a-75b2e567647e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.639740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0e810-1b97-4901-806a-75b2e567647e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.640019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0e810-1b97-4901-806a-75b2e567647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.665122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a7b0e810-1b97-4901-806a-75b2e567647e None None] MFA Rules not processed for user `4af43af4621e4400b481d3de28aa78a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:15:27.666347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a7b0e810-1b97-4901-806a-75b2e567647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:27.727562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 742/1502] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:15:27.740360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd175f8-d51f-40f8-adb4-159b2200e545 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.740653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd175f8-d51f-40f8-adb4-159b2200e545 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.740929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd175f8-d51f-40f8-adb4-159b2200e545 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.742325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 761/1503] 10.222.0.13 () {54 vars in 963 bytes} [Mon May 16 22:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:15:27.747903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4b7d9-c301-45ef-a085-9a4419a50efe None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.748226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4b7d9-c301-45ef-a085-9a4419a50efe None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.748504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4b7d9-c301-45ef-a085-9a4419a50efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.766699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b8a4b7d9-c301-45ef-a085-9a4419a50efe None None] MFA Rules not processed for user `4e8bbada4fbb48a186e373ac378e1fda`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:15:27.767819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b8a4b7d9-c301-45ef-a085-9a4419a50efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:27.815615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 743/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Mon May 16 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:15:27.823002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd175f8-d51f-40f8-adb4-159b2200e545 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.834072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd175f8-d51f-40f8-adb4-159b2200e545 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.837548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.838174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.838452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.838727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.846820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.848236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:27.856728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 762/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:15:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:15:27.899176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033568e3-9f6b-4133-9044-77b25083f673 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.899473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033568e3-9f6b-4133-9044-77b25083f673 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.899753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033568e3-9f6b-4133-9044-77b25083f673 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.901670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 744/1506] 10.222.0.13 () {52 vars in 829 bytes} [Mon May 16 22:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:15:27.905143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:27.966572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f4372-7583-484b-b445-3e5009b6a67b service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:27.972588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:27.973533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:27.973811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:27.974098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] PATH_INFO: `/v3/users/4af43af4621e4400b481d3de28aa78a1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:27.975310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af43af4621e4400b481d3de28aa78a1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:27.976330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:27.976330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:15:27.976330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:15:27.977582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:28.040732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af43af4621e4400b481d3de28aa78a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.053556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af43af4621e4400b481d3de28aa78a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.062697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af43af4621e4400b481d3de28aa78a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.063337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af43af4621e4400b481d3de28aa78a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.080752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af43af4621e4400b481d3de28aa78a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.086612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 763/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:15:27 2022] DELETE /identity/v3/users/4af43af4621e4400b481d3de28aa78a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:15:28.091205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:28.091519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:28.091795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:28.108773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:15:28.109987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:28.163173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 745/1508] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:15:28.173393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:28.174802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:28.228324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118cec-8062-4047-b211-668eaa1f3857 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:28.232388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:28.233022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:28.233328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:28.233602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:28.242119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:28.243552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cd007-5d6b-4f84-81f8-6316eaa1f967 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:28.253099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 764/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:15:28.590919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:15:28.592663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:15:28.604549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e705622-d2c2-47fc-9e3b-112216b3d564 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:15:28.610930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:15:28.611972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:15:28.612280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:15:28.612553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] PATH_INFO: `/v3/projects/bd9a974d4935487f9f74aa8efe217b5c` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:15:28.613751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9a974d4935487f9f74aa8efe217b5c)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:15:28.614778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:15:28.614778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:15:28.614778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:15:28.616994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:15:28.679576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9a974d4935487f9f74aa8efe217b5c', 'request_id': 'req-516ab924-7741-4097-96ba-60052b756c12'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.685234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9a974d4935487f9f74aa8efe217b5c', 'request_id': 'req-516ab924-7741-4097-96ba-60052b756c12'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.694690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9a974d4935487f9f74aa8efe217b5c', 'request_id': 'req-516ab924-7741-4097-96ba-60052b756c12'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.712540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] The token cache is being invalidate because project bd9a974d4935487f9f74aa8efe217b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:15:28.712828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.713599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-516ab924-7741-4097-96ba-60052b756c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:15:28.715635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 746/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:15:28 2022] DELETE /identity/v3/projects/bd9a974d4935487f9f74aa8efe217b5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:17:06.375588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:06.376183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:06.376183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:06.377576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:06.382595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4682d8-9967-40db-8816-30ca8aa3d530 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:06.383022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4682d8-9967-40db-8816-30ca8aa3d530 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:06.383148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4682d8-9967-40db-8816-30ca8aa3d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:06.400851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-fe4682d8-9967-40db-8816-30ca8aa3d530 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:06.402089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-fe4682d8-9967-40db-8816-30ca8aa3d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:06.456767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:06.622830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:06.624544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:06.695240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff27099-7a6d-4ad7-ae1e-6de1dde33e51 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:06.700571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:06.701224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:06.701526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:06.701804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:06.709739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:06.711321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23976d-554a-4124-8f2a-cc27602e76ea service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:06.721013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 766/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:07.553241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48ce4-9d8c-402b-a839-328dc0e53568 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:07.553830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48ce4-9d8c-402b-a839-328dc0e53568 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:07.553830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad48ce4-9d8c-402b-a839-328dc0e53568 None None] PATH_INFO: `/v3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:07.555082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 748/1514] 10.222.0.61 () {54 vars in 925 bytes} [Mon May 16 22:17:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:17:07.561426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:07.561846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:07.562034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:07.582292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:07.583504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:07.628550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e3e2-9b84-41b2-8ed3-c3021e302261 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:07.628753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e3e2-9b84-41b2-8ed3-c3021e302261 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:07.629022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5e3e2-9b84-41b2-8ed3-c3021e302261 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:07.630428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 749/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 22:17:07.635427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9d47-8dda-4dc1-91f7-6b05dc674b40 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:07.635719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9d47-8dda-4dc1-91f7-6b05dc674b40 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:07.635995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f9d47-8dda-4dc1-91f7-6b05dc674b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:07.645063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 767/1516] 10.222.0.61 () {58 vars in 1015 bytes} [Mon May 16 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:07.653668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-195f9d47-8dda-4dc1-91f7-6b05dc674b40 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:07.654896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-195f9d47-8dda-4dc1-91f7-6b05dc674b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:07.663245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 750/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:17:07.812576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:07.824759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe8d3-1782-421f-93d1-4af7160de46a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:07.830800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:07.831435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:07.832140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:07.832412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:07.840528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:07.842133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7d9c4-2fee-4bdf-b755-cb862d732593 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:07.852171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 768/1518] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:11.524105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4207f-c089-4941-9e70-4b026fec127b None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:11.524637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4207f-c089-4941-9e70-4b026fec127b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:11.524637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4207f-c089-4941-9e70-4b026fec127b None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:11.526064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 751/1519] 10.222.0.13 () {54 vars in 960 bytes} [Mon May 16 22:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:11.531726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594ccb-5e82-4338-a7cb-316efc790dc2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:11.532157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594ccb-5e82-4338-a7cb-316efc790dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:11.532302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594ccb-5e82-4338-a7cb-316efc790dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:11.550155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-62594ccb-5e82-4338-a7cb-316efc790dc2 None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:11.551405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-62594ccb-5e82-4338-a7cb-316efc790dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:11.560396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 769/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Mon May 16 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:11.569321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4207f-c089-4941-9e70-4b026fec127b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:11.582870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4207f-c089-4941-9e70-4b026fec127b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:11.588087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:11.588749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:11.589028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:11.589343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:11.600549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:11.602616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc912d-6fd8-44fa-a875-3d2a3c44552a service placement] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:11.614274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 752/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:19.164650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf1c4-3291-4f63-b2b5-5524f86769cd None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:19.165269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf1c4-3291-4f63-b2b5-5524f86769cd None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:19.165269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf1c4-3291-4f63-b2b5-5524f86769cd None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:19.166562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:19.171766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045735-f408-4d46-b228-c11d9809bf47 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:19.172305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045735-f408-4d46-b228-c11d9809bf47 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:19.172305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76045735-f408-4d46-b228-c11d9809bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:19.190504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-76045735-f408-4d46-b228-c11d9809bf47 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:19.191703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-76045735-f408-4d46-b228-c11d9809bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:19.199509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:19.357751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf1c4-3291-4f63-b2b5-5524f86769cd None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:19.372690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf1c4-3291-4f63-b2b5-5524f86769cd None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:19.378002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:19.378623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:19.378904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:19.379175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:19.387545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:19.389103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af606229-2f68-4b98-a70d-b9ddbf4a5526 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:19.398171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 771/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:20.292020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9e65-8dc5-42cd-a874-62c321c49d84 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:20.292599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9e65-8dc5-42cd-a874-62c321c49d84 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:20.292599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9e65-8dc5-42cd-a874-62c321c49d84 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:20.294019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 22:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:20.298846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fada2-26e4-4904-afef-146bc8efea14 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:20.299277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fada2-26e4-4904-afef-146bc8efea14 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:20.299393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fada2-26e4-4904-afef-146bc8efea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:20.317084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f24fada2-26e4-4904-afef-146bc8efea14 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:20.318301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f24fada2-26e4-4904-afef-146bc8efea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:20.326175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:20.476325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9e65-8dc5-42cd-a874-62c321c49d84 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:20.490782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9e65-8dc5-42cd-a874-62c321c49d84 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:20.496098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:20.496732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:20.497014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:20.497313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:20.505921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:20.507506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88cdd5-26d8-4f69-a1a7-d496ad8db97d service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:20.516920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 755/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:24.489271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:24.489810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:24.489902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:24.491273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:24.496409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8d-5478-4677-ab80-951cc7394fb1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:24.496842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8d-5478-4677-ab80-951cc7394fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:24.496976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8d-5478-4677-ab80-951cc7394fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:24.516814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b5472f8d-5478-4677-ab80-951cc7394fb1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:24.518037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b5472f8d-5478-4677-ab80-951cc7394fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:24.525659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:24.561568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:24.563330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:24.617594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fdcc1-d4a0-4522-a177-1caabaed84c9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:24.621047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:24.621713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:24.621992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:24.622266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:24.632312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:24.633815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be2e87-66d9-445f-b199-ad2fc90df8c4 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:24.643292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 774/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:26.826081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caed3-51a4-4e44-b837-bd171b563270 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:26.827186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caed3-51a4-4e44-b837-bd171b563270 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:26.827301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caed3-51a4-4e44-b837-bd171b563270 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:26.828634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:26.834008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bef7-c3c9-4f2e-b4c8-2f156d6e7593 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:26.834438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bef7-c3c9-4f2e-b4c8-2f156d6e7593 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:26.834568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9bef7-c3c9-4f2e-b4c8-2f156d6e7593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:26.851957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-61f9bef7-c3c9-4f2e-b4c8-2f156d6e7593 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:26.853127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-61f9bef7-c3c9-4f2e-b4c8-2f156d6e7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:26.860731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:26.899378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caed3-51a4-4e44-b837-bd171b563270 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:26.910166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caed3-51a4-4e44-b837-bd171b563270 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:26.913635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:26.914262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:26.914542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:26.914814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:26.923384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:26.924790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15b094-62bb-4b23-9ec5-0546fc31e26b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:26.933879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 758/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:30.612241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:30.612783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:30.612783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:30.614190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:30.619484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258dba-5aae-49bf-b9ce-cf5ed3fd6232 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:30.619873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258dba-5aae-49bf-b9ce-cf5ed3fd6232 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:30.620041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258dba-5aae-49bf-b9ce-cf5ed3fd6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:30.637438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ff258dba-5aae-49bf-b9ce-cf5ed3fd6232 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:30.638612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ff258dba-5aae-49bf-b9ce-cf5ed3fd6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:30.646233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:30.919102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:30.920937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:30.977254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab144e-b71d-4c22-9965-9f9db3ae92e2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:30.980762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:30.981431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:30.981718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:30.982008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:30.990701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:30.992139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb35e5-22ab-4506-9b38-382431fded48 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:31.001265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 777/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:17:33.247337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:33.247863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:33.247863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:33.249748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 22:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:17:33.254928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e1e-c108-4e26-9dca-ad47f7d35e29 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:33.255325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e1e-c108-4e26-9dca-ad47f7d35e29 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:33.255506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7e1e-c108-4e26-9dca-ad47f7d35e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:33.273378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f31b7e1e-c108-4e26-9dca-ad47f7d35e29 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:17:33.274560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f31b7e1e-c108-4e26-9dca-ad47f7d35e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:33.282200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:17:33.549371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:17:33.551070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:17:33.563731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5643-3507-4a80-b850-b46f69a34d37 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:17:33.567174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:17:33.567796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:17:33.568075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:17:33.568346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:17:33.577318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:17:33.578744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182f193-3d34-4e6c-b4fe-a4280b12b81e service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:17:33.588178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 761/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:04.007707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.008768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.009289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.040228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.041365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.056226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 779/1540] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:04.066545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.067088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.067088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.089381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.090586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.104032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 762/1541] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:04.109602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.119879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9fb0-6431-410a-a2a7-a71c7d181049 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.129060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.130067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.130067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.130352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.131098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:04.131409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.132461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:04.132461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:19:04.132461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:19:04.133422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.147735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 780/1542] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:04.156110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.165972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13127df2-3da7-44cb-8cdd-49dde136942b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.176877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.177577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.178002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.178280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.178992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.180019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:04.180019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:19:04.180019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:19:04.181265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.230969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 763/1543] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:04.235681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.246818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c84cc-04bb-47a3-b52b-acf485fd7736 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.336460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.337082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.337396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.338076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.338816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.339955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:04.339955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:19:04.339955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:19:04.341223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8810747-e512-4692-a847-ed6e3d9893cd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.371624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 781/1544] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:04.376048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.390857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0ff46-4101-4114-b69a-56616c8a1bfd admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.397293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.397984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.398185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.398297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.398531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.398821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.399120 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.399411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.401079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.413198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 764/1545] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:04.418320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.422769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.424004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.435005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea53a74-aaa0-4882-abac-fe2486e5687a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.446806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.447491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.447773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.448044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.448768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.450897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 782/1546] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:04.452282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e29a04-b46b-4e22-b0fc-6be37fe481a4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.467297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 765/1547] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:04.472452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.485176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc028-7733-4df6-a3bc-ce710c77489b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.485495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc028-7733-4df6-a3bc-ce710c77489b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.485760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc028-7733-4df6-a3bc-ce710c77489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.489271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384077c-6d22-48d8-87f2-0ec4e20b51f5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.501929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.502855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.503135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.503536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] PATH_INFO: `/v3/projects/8f3dbe773b374e928351f345b8cd02c5/users/aff1714d30374afe8d669f9f3c4f0c81/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.536621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-410bc028-7733-4df6-a3bc-ce710c77489b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.537950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-410bc028-7733-4df6-a3bc-ce710c77489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.539495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3dbe773b374e928351f345b8cd02c5, user_id=aff1714d30374afe8d669f9f3c4f0c81, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.543103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfcd27-1183-4ea2-81c8-0b840f63a0a6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.546869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 766/1548] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.548259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.548635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.549075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.567144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 783/1549] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:04 2022] PUT /identity/v3/projects/8f3dbe773b374e928351f345b8cd02c5/users/aff1714d30374afe8d669f9f3c4f0c81/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:04.568485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf74976-e5cb-47f6-a13c-1e95be30ddd6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.568778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf74976-e5cb-47f6-a13c-1e95be30ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.569056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf74976-e5cb-47f6-a13c-1e95be30ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.574977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.577100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.602905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-adf74976-e5cb-47f6-a13c-1e95be30ddd6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.604531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-adf74976-e5cb-47f6-a13c-1e95be30ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.649922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 767/1550] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.650779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.660568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e244c1f-d1aa-4817-b581-50e186b199cf None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.665014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 784/1551] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.665261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.665902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.666191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.666420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ff93-7a2a-4fdc-b230-cbcdf2b2927c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.666526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.666759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ff93-7a2a-4fdc-b230-cbcdf2b2927c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.667037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21ff93-7a2a-4fdc-b230-cbcdf2b2927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.667167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:04.667473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.669097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe8141-c70e-4787-8e20-65e02fc2d965 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.680743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 768/1552] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:04.682164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2335-bd6c-4985-86c8-58dd9bf509ec None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.682580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2335-bd6c-4985-86c8-58dd9bf509ec None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.682866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd2335-bd6c-4985-86c8-58dd9bf509ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.684575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0b21ff93-7a2a-4fdc-b230-cbcdf2b2927c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.685809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0b21ff93-7a2a-4fdc-b230-cbcdf2b2927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.693720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 785/1553] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.694942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b6e3-eb3d-4ef0-a661-59fd17da1085 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.695231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b6e3-eb3d-4ef0-a661-59fd17da1085 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.695513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98b6e3-eb3d-4ef0-a661-59fd17da1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.709411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-89fd2335-bd6c-4985-86c8-58dd9bf509ec None None] MFA Rules not processed for user `aff1714d30374afe8d669f9f3c4f0c81`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.710600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-89fd2335-bd6c-4985-86c8-58dd9bf509ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.713082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3a98b6e3-eb3d-4ef0-a661-59fd17da1085 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.714393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a98b6e3-eb3d-4ef0-a661-59fd17da1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.722986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 786/1554] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.724211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdefbe-3b84-426f-b52d-f31f4d6044db None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.724499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdefbe-3b84-426f-b52d-f31f4d6044db None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.724778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdefbe-3b84-426f-b52d-f31f4d6044db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.741784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c0bdefbe-3b84-426f-b52d-f31f4d6044db None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.742970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c0bdefbe-3b84-426f-b52d-f31f4d6044db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.751191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 787/1555] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.753222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc8ea-885a-4434-9e91-ff0b3838a741 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.753524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc8ea-885a-4434-9e91-ff0b3838a741 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.753803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bc8ea-885a-4434-9e91-ff0b3838a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.771707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e24bc8ea-885a-4434-9e91-ff0b3838a741 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.772672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 769/1556] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.772902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e24bc8ea-885a-4434-9e91-ff0b3838a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.773978 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.774264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.774538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.781684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 788/1557] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.782910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28a4-00eb-4989-a5dd-cbc7497c5786 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.783200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28a4-00eb-4989-a5dd-cbc7497c5786 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.783482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b28a4-00eb-4989-a5dd-cbc7497c5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.792694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.793918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.800358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-939b28a4-00eb-4989-a5dd-cbc7497c5786 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.801559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-939b28a4-00eb-4989-a5dd-cbc7497c5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.805766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 770/1558] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.805766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.809667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 789/1559] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.811354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f21f-5b29-4084-8bf2-dbe259524413 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.811679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f21f-5b29-4084-8bf2-dbe259524413 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.811963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f21f-5b29-4084-8bf2-dbe259524413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.812611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca858-270c-40fb-8330-d93e7edd3db4 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.817094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.817758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.818039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.818311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.818985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.820896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f0f4f-ad5e-4055-8c80-87bc20a78673 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.829682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5da9f21f-5b29-4084-8bf2-dbe259524413 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.830862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5da9f21f-5b29-4084-8bf2-dbe259524413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.838983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 790/1560] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.840088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.840378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.840656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.853806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 771/1561] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:04.855433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0480da-06e7-4886-ab71-ac2ecbb648e7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.855726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0480da-06e7-4886-ab71-ac2ecbb648e7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.856000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0480da-06e7-4886-ab71-ac2ecbb648e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.862588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.863784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.873137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4a0480da-06e7-4886-ab71-ac2ecbb648e7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.874353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4a0480da-06e7-4886-ab71-ac2ecbb648e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.920653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 791/1562] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.921618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.930760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d578a30-3293-45f7-af8f-23a03015a5e3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:04.931179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 772/1563] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.932500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.932780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.933083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.939251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:04.939927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:04.940206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:04.940484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:04.941171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:04.943161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:04.952051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:04.953794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:04.961552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 773/1564] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:04.962366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.969362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 792/1565] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:04 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:04.970338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:04.972280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb373e9c-4e1b-4ebd-a1fb-79f1788eb607 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.026228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.026890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.027168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.027439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.028147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.028447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.029796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74b8b7-fb3c-427a-8e88-da61237ea3c2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.030303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.034630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.035295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.036112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.036399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.037160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.037537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.039168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.040959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 774/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.041783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.053251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 793/1567] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.053440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335efea-d6d6-4ade-8643-6ea202ff90ac admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.053542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.056144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.056793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.057075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.057421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.058094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.058427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.061542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1f8e-7f2b-4dba-8ec4-13c5b1aabe6e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.063903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.067222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.068032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.068319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.068605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.069338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.071339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.084059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 775/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.084059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.091285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0839c-45b7-48d5-84bd-ececfbf4fd8e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.096114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.096763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.097049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.097381 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.100843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 794/1569] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.100990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.100990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.101190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.101309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.108214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51715387-548e-482a-8aa2-f8143ccec60a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.111514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 776/1570] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.112338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.119801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.120503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.120789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.121064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.121610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5099c-66a4-420e-88da-34523284ca66 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.121856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.122220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.123820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.126622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.127253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.127530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.127800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.128494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:05.128792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.130384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.136617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 795/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.137607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.142622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 777/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:05.143395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.148647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe028576-55cb-4bf4-80b1-c8b8be8c5187 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.153716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.154396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.154653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.154927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.155757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.157689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.158183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcf352-42dd-4425-a19a-6aef8ff912a7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.162658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.163290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.163571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.163845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.165149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.167112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.177896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 796/1573] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.178681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.188727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11352a-8248-4b5c-8aee-3ce98857525a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.196118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 778/1574] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.196260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.196408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.196507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.196507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.196507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.196507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.197131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.223458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 797/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.224278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.257012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed31b35-5e1a-4458-9d98-94c50d42c275 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.283340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481890b0-31c2-4d08-b3c8-a595bed7d883 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.287859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.288539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.288899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.289111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.289834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.291436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.301045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 798/1576] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.301650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.310535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9953-fa15-4ff5-bba5-3ac0fed6b55d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.312773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.313529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.313809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.314101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.314872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.315477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.316097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.316379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.316655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.316817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.317340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.319314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.343122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 779/1577] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.344107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.350253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 799/1578] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.350253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.403034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d2b13-ba5e-476b-b1ef-11fb837fcaf7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.407445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.408098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.408376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c898034-b087-4f26-b26f-08876044feea admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.408499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.408648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.409366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.411280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.413038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.413735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.414024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.414311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.414993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.416884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.438125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 780/1579] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.438955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.442000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 800/1580] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.443098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.502475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6fef8-3c48-44fe-97c8-49ec99ff6708 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.506077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a612f-715c-4ff5-ab74-4c0d65e05624 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.507136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.507804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.508087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.508364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.509225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.510954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.511079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.511620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.511904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.512186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.512870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.514886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.520921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 781/1581] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.521572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.533728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0266-7110-41a2-859f-621eebc832a6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.534610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 801/1582] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.535385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.541441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.542098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.542385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.542666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.543353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.544520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6306e-c7d0-4cee-b9bd-004541b5faec admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.545296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.549670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.550303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.550588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.550866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.551581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.553165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.564376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 802/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.565182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.569028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 782/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.569028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.574672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b911e-9b25-4174-9001-337649774a7c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.577768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d400-530b-4c0a-beb9-f42754eb09ce admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.579359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.580005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.580296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.580575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.581277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.582216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.582849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.583126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.583248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.583395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.584084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.586007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.603888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 803/1585] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.604691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.605430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 783/1586] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.606090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.615340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27ca17-4fa1-4944-8a3d-7e1c1c7043ea admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.618500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779b36-38aa-44a4-b002-0a46890bb84e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.620356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.621020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.621336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.621617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.622351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.623296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.623936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.624764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.624863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.625060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.625764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.628090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.645904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 804/1587] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.646776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.651453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 784/1588] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:05.652430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.659042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcc8ce-54a5-448b-ab21-3e96451a5c9b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.661871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c507b-0f89-4f44-926f-0e805fb1d32f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.663627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.664583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.664870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.665148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] PATH_INFO: `/v3/projects/44df3f998c5a44018116ec9e6f256397/users/587b3acbc67746b5803435a2572f55de/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.666553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.667191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.667468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.667836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.668555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.670163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.680409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44df3f998c5a44018116ec9e6f256397, user_id=587b3acbc67746b5803435a2572f55de, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.680655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 785/1589] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.681449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.683260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.691760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172134-3fe9-4743-8108-9c79d5078105 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.696942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 805/1590] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:05 2022] PUT /identity/v3/projects/44df3f998c5a44018116ec9e6f256397/users/587b3acbc67746b5803435a2572f55de/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:05.697945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.746499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.747402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.747673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.747948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] PATH_INFO: `/v3/projects/d26fdbe69d80411d9cc8c1cbe579a6da/users/db13a3e0bbfc41788ffce6ec0627a14d/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.756816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885e894-2973-417c-9656-62f3bd8163b4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.761628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.761962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26fdbe69d80411d9cc8c1cbe579a6da, user_id=db13a3e0bbfc41788ffce6ec0627a14d, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.762287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.762571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.762848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.762996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:05.762996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:19:05.762996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:19:05.763566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.765015 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.765728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.776284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 806/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.777077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.779053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 786/1592] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:05 2022] PUT /identity/v3/projects/d26fdbe69d80411d9cc8c1cbe579a6da/users/db13a3e0bbfc41788ffce6ec0627a14d/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:05.779854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.789889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e9007-8714-4fe0-a14b-8001b3a0355f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.840397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820efb4f-d9ad-4192-bf79-558f443da839 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.844960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.845448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.845679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.845960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.846105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.846236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.846382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.846651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.846953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.847357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.848592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.848918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.858225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 807/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.858443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 787/1594] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.859786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.860167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.870227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5696ca-73b2-43b1-94dd-1caa2f1dd489 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.870515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d99ad6-be98-4039-b9db-f0958a1a5f49 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.874852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.875491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.875773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.875943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.876062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.876592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.876740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.876875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.877148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.877893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.878339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.879454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.888637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 808/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.889525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.889658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 788/1596] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.890484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.899703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981b91d-b701-463c-a4b1-d679acc1f398 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.901572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26921a17-53c3-4ae2-807c-671db5b3da6d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.904190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.904819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.905101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.905922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.906656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.906890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.907533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.907816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.908087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.908257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.908831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.910692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fffdd9-a0e2-4ac7-9cde-29402c0d4e91 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.917886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 789/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.918819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.921993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 809/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.923395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.923690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.923969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.929517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6c84-09ef-4a97-bcc4-97aebf426963 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.934026 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.934664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.934943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.935503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.935906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.937530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.947464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 790/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.948309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.952172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] MFA Rules not processed for user `db13a3e0bbfc41788ffce6ec0627a14d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:05.953438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:05.958063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d3df4-aecd-40a6-b957-2238b9d2d57a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.963953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.964688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.964968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.965269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.966058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.967756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:05.978806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 791/1600] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:05.980063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:05.990157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ac8b8-67ff-4faf-9d29-68f208fb8a87 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:05.994744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:05.995382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:05.995663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:05.995933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:05.996636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:05.998234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.007797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 792/1601] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:06.008651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.018028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45a36b-6a14-441a-b40d-ff4930ea9959 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.020360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 810/1602] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.021217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.026272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.026922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.027200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.027472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.028182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.029814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.034608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fe87-37cd-4d9b-a396-c9377c19c545 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.039970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.040631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.040735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 793/1603] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:06.040912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.041184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.041574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.042022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.043637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.051355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b396098-8698-4352-89ab-06027b6019eb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.057735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 811/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:06.057735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.057942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.057942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.057942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.057942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] PATH_INFO: `/v3/projects/44df3f998c5a44018116ec9e6f256397/users/587b3acbc67746b5803435a2572f55de/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.059375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44df3f998c5a44018116ec9e6f256397, user_id=587b3acbc67746b5803435a2572f55de, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.062063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.064577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92027d-a3c3-4a88-9704-3201c34ef4bc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.069150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.070098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.070320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.070599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] PATH_INFO: `/v3/projects/99a22be98b7e4f4c859f581f3aeb590d/users/1e3861c9f6dd47c8b1d92edc759b587a/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.071986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 794/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/44df3f998c5a44018116ec9e6f256397/users/587b3acbc67746b5803435a2572f55de/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.072797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.086344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a22be98b7e4f4c859f581f3aeb590d, user_id=1e3861c9f6dd47c8b1d92edc759b587a, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.089342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.102388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 812/1606] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/99a22be98b7e4f4c859f581f3aeb590d/users/1e3861c9f6dd47c8b1d92edc759b587a/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.103289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.132194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe8884-1fc0-498b-95b2-18909a38ad5f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.163195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb64658-07e1-4dbe-8ef9-a420ac70c6c1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.167896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.168777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.169060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.169436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] PATH_INFO: `/v3/projects/39b249a6fe6240c69bc1252aaf666c24/users/4b14b25d1fd843dd823e4a89e4d0391c/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.183069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b249a6fe6240c69bc1252aaf666c24, user_id=4b14b25d1fd843dd823e4a89e4d0391c, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.185829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.186231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.187116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.187391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.187661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] PATH_INFO: `/v3/projects/dd543ac61ee64797b43e960f4ddec858/users/de089161e46349db878d6d12d1fc3d42/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.198445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 813/1607] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/39b249a6fe6240c69bc1252aaf666c24/users/4b14b25d1fd843dd823e4a89e4d0391c/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.199341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.203899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd543ac61ee64797b43e960f4ddec858, user_id=de089161e46349db878d6d12d1fc3d42, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.206614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92246464-0e52-4d6f-b391-f712959ec498 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.219278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 795/1608] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/dd543ac61ee64797b43e960f4ddec858/users/de089161e46349db878d6d12d1fc3d42/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.220825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b1cf-8664-43a4-ae2c-188df9f10f76 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.221050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b1cf-8664-43a4-ae2c-188df9f10f76 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.221349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b1cf-8664-43a4-ae2c-188df9f10f76 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.223018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 796/1609] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 22:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:06.223708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b1cf-8664-43a4-ae2c-188df9f10f76 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.263233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781b28a-6e76-4144-81cc-23fd7a13bb60 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.284890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b1cf-8664-43a4-ae2c-188df9f10f76 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.289338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.290229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.290519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.290797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] PATH_INFO: `/v3/projects/e0f8e4eb495e495cae3200ee7f568644/users/0e26b5e1aca149959a14e453cde17f01/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.304716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f8e4eb495e495cae3200ee7f568644, user_id=0e26b5e1aca149959a14e453cde17f01, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.307477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.317656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.318583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.318862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.319133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] PATH_INFO: `/v3/projects/9865f76728534bd4a16949abe04f7c21/users/3d32a8df74c74851adf017d2132ad13c/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.322445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 797/1610] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/e0f8e4eb495e495cae3200ee7f568644/users/0e26b5e1aca149959a14e453cde17f01/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.323343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.337334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9865f76728534bd4a16949abe04f7c21, user_id=3d32a8df74c74851adf017d2132ad13c, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.341956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1155b-dea5-4d77-96d4-921310454d84 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.358089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 814/1611] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/9865f76728534bd4a16949abe04f7c21/users/3d32a8df74c74851adf017d2132ad13c/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.359511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240ea7a-4009-4380-b034-231073866287 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.359804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240ea7a-4009-4380-b034-231073866287 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.360095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240ea7a-4009-4380-b034-231073866287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.385570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9240ea7a-4009-4380-b034-231073866287 None None] MFA Rules not processed for user `587b3acbc67746b5803435a2572f55de`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.387013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9240ea7a-4009-4380-b034-231073866287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.391738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594288-805b-4aeb-bc38-d08287b1697e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.444611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.445529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.445813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.446196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] PATH_INFO: `/v3/projects/b4b0e4ddef624ac4b91c44d0c6154da7/users/6d960067f49b43a7bd26af6c0a20d369/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.450751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 815/1612] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.453505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab750-081a-4892-a9ec-2606ede2fa82 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.453805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab750-081a-4892-a9ec-2606ede2fa82 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.454097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab750-081a-4892-a9ec-2606ede2fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.462899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0e4ddef624ac4b91c44d0c6154da7, user_id=6d960067f49b43a7bd26af6c0a20d369, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.465755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4615-6a80-44ad-ad34-a7fa80f87487 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.480011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 798/1613] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:06 2022] PUT /identity/v3/projects/b4b0e4ddef624ac4b91c44d0c6154da7/users/6d960067f49b43a7bd26af6c0a20d369/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:06.481234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dab93-efd5-4130-80f1-be043afc6d88 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.481526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dab93-efd5-4130-80f1-be043afc6d88 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.481803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dab93-efd5-4130-80f1-be043afc6d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.482763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e58ab750-081a-4892-a9ec-2606ede2fa82 None None] MFA Rules not processed for user `1e3861c9f6dd47c8b1d92edc759b587a`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.484015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e58ab750-081a-4892-a9ec-2606ede2fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.498119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9c6dab93-efd5-4130-80f1-be043afc6d88 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.499850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9c6dab93-efd5-4130-80f1-be043afc6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.545537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 816/1614] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.546930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26942-998f-43a7-aa57-823ab3ece142 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.547223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26942-998f-43a7-aa57-823ab3ece142 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.547528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c26942-998f-43a7-aa57-823ab3ece142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.561048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 799/1615] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.563194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a83-f0e1-43c3-b2fa-7dccd36e256b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.563657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a83-f0e1-43c3-b2fa-7dccd36e256b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.564088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700a83-f0e1-43c3-b2fa-7dccd36e256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.564709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a1c26942-998f-43a7-aa57-823ab3ece142 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.566057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a1c26942-998f-43a7-aa57-823ab3ece142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.574663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 817/1616] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.575932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.576224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.576506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.586269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b6700a83-f0e1-43c3-b2fa-7dccd36e256b None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.587460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b6700a83-f0e1-43c3-b2fa-7dccd36e256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.602879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] MFA Rules not processed for user `0e26b5e1aca149959a14e453cde17f01`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.604084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.656458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 800/1617] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.657824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077b7-5fbc-41ea-a65d-fec5cbbfa937 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.658215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077b7-5fbc-41ea-a65d-fec5cbbfa937 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.658680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024077b7-5fbc-41ea-a65d-fec5cbbfa937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.670332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 818/1618] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.671331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.678942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-024077b7-5fbc-41ea-a65d-fec5cbbfa937 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.680431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-024077b7-5fbc-41ea-a65d-fec5cbbfa937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.689792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 801/1619] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.692780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0dce-6963-40c5-af4e-8a147508d857 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.693064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0dce-6963-40c5-af4e-8a147508d857 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.693408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0dce-6963-40c5-af4e-8a147508d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.711139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f4ba0dce-6963-40c5-af4e-8a147508d857 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.712244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f4ba0dce-6963-40c5-af4e-8a147508d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:06.719779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 802/1620] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:06.720999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88486e-e128-4116-82bc-6bb8f0522f94 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.721315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88486e-e128-4116-82bc-6bb8f0522f94 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.721588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88486e-e128-4116-82bc-6bb8f0522f94 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.723064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 803/1621] 10.222.0.13 () {54 vars in 961 bytes} [Mon May 16 22:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:06.723780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88486e-e128-4116-82bc-6bb8f0522f94 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.730373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538af7e6-16bc-45e7-9630-82964d06d1cb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.734027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.734674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.734954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.735227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.777501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88486e-e128-4116-82bc-6bb8f0522f94 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.781075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.781747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.782029 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.782407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.788788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.790261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.791155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.792577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.799767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 819/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:06.802435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.803499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 804/1623] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:06.803960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.813464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c82ae-f1c3-4d2a-912a-b4675fbe5276 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.817368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.817757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197e62-bc5f-491e-8b5e-744a671aa879 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.818173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.818636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.818979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.825894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.826758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.827147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.828075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.830501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.835540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.846597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 820/1624] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:06.847523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.857457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b0a8-bb77-4b14-b443-7c392bae1453 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:06.870226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:06.871526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.872304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.872646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.873585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.877141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.907359 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:06.909697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd91ca8-1b78-4c14-bb82-286ee6e01a4b service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:06.919560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 821/1625] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:06.919560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:06.920887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 805/1626] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:06.922888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:06.923183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:06.923599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:06.948027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:06.950132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:07.036032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a9d5-3db8-4b81-9300-189d94ad2388 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.047508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.049543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.049831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.050983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.058005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 806/1627] 10.222.0.13 () {58 vars in 1058 bytes} [Mon May 16 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:07.059284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.079783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb873e-9d07-41e3-8c7d-da3ff720c5b9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.093060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.093765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.094049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.094482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.142948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.144808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.156465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 822/1628] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:07.157877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.168136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d75181-a6d6-4c9d-bae3-02c3ffdd98c4 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.174429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.175550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.176045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.176534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.177467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.179826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.184100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.186268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.207261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 807/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:07.208559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.219891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 823/1630] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:07 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:07.224262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.235296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5af9-7fae-49f1-b336-bd13cb2a974e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.240620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.241494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.241966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.242354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.243198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.245145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2f796-297e-4c3f-a602-999f688765da admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.245859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7b96d-c5b2-4254-9372-7a9fc19bb347 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.256877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 824/1631] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:07.261686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddfad-3771-4717-84ce-dd6de859e415 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.262170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.262378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddfad-3771-4717-84ce-dd6de859e415 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.262772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddfad-3771-4717-84ce-dd6de859e415 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.262908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.263177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.263561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.264828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 825/1632] 10.222.0.13 () {54 vars in 912 bytes} [Mon May 16 22:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:07.265658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dddfad-3771-4717-84ce-dd6de859e415 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.279971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dddfad-3771-4717-84ce-dd6de859e415 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.286706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.287704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.288052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.288802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] PATH_INFO: `/v3/projects/e4e41c8bb905451488d4e3896bb605cd/users/83bec30cc62543cf9262fbb98db1092a/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.308480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e41c8bb905451488d4e3896bb605cd, user_id=83bec30cc62543cf9262fbb98db1092a, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.311780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f788de-a77b-4d2c-9750-ab9a0ca267cc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.329965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 826/1633] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:07 2022] PUT /identity/v3/projects/e4e41c8bb905451488d4e3896bb605cd/users/83bec30cc62543cf9262fbb98db1092a/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:07.334956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.335252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.337981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.353528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.359940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.362542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:07.364027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:07.374901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 808/1634] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:07.376228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.388414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771feb58-c811-448b-8053-98289626bcd1 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.447580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 827/1635] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:19:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:07.453810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.455630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.456153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.456617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.457682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.460536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.461790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.480624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 809/1636] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:07.487017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.513134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59926334-dba4-45b0-aaa3-62128b579b1c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.527518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.529542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.531635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.532705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] PATH_INFO: `/v3/projects/e4e41c8bb905451488d4e3896bb605cd/users/83bec30cc62543cf9262fbb98db1092a/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.538942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e41c8bb905451488d4e3896bb605cd, user_id=83bec30cc62543cf9262fbb98db1092a, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.553993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3ed87-550b-424d-9cc8-50ebef27b312 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.554156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4effe-ebfa-417b-a2cd-6b4c5d0f80ff admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.565373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:07.566883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.567370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.568471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.588860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 810/1637] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:07 2022] PUT /identity/v3/projects/e4e41c8bb905451488d4e3896bb605cd/users/83bec30cc62543cf9262fbb98db1092a/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:07.601468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c6ca-4b7e-462b-aa71-5b2b4305370d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.601871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c6ca-4b7e-462b-aa71-5b2b4305370d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.602273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c6ca-4b7e-462b-aa71-5b2b4305370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.619788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:07.621030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:07.645317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 828/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:07.647263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5ff2c6ca-4b7e-462b-aa71-5b2b4305370d None None] MFA Rules not processed for user `83bec30cc62543cf9262fbb98db1092a`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:07.649174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5ff2c6ca-4b7e-462b-aa71-5b2b4305370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:07.807678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 811/1639] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:07.825460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:07.844251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41feb-3968-4ad4-94ce-0b6cacee7f4a service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:07.976646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68672-1805-4b9f-ba7b-956a087a32ee None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.976891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68672-1805-4b9f-ba7b-956a087a32ee None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.977216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68672-1805-4b9f-ba7b-956a087a32ee None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:07.980157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 812/1640] 10.222.0.13 () {54 vars in 912 bytes} [Mon May 16 22:19:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:07.997433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e4c8-87e9-4f42-84e2-44e71f234c8c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:07.997839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e4c8-87e9-4f42-84e2-44e71f234c8c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:07.998157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e4c8-87e9-4f42-84e2-44e71f234c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.013580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:08.015592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.015876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.016880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.041000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:08.042496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:08.046861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5934e4c8-87e9-4f42-84e2-44e71f234c8c None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:08.049807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5934e4c8-87e9-4f42-84e2-44e71f234c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:08.073336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 829/1641] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:08.192891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 813/1642] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:19:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:08.249749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:08.267442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71754061-5c0e-4d3e-ac1a-645e9b8cdf2f service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:08.272248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:08.272960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.273318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.273601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.288890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:08.290454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:08.336590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 830/1643] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:08.604906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f64b0-02e6-47af-82ce-e10e738efd67 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.605305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f64b0-02e6-47af-82ce-e10e738efd67 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.605698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f64b0-02e6-47af-82ce-e10e738efd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.692817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-4b6f64b0-02e6-47af-82ce-e10e738efd67 None None] MFA Rules not processed for user `4b14b25d1fd843dd823e4a89e4d0391c`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:08.695902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4b6f64b0-02e6-47af-82ce-e10e738efd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:08.728283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:08.815823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 814/1644] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:08.828556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.833156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.833958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.863755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] MFA Rules not processed for user `4b14b25d1fd843dd823e4a89e4d0391c`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:08.866377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:08.872980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f9d92-bacc-4799-91d4-22a6cda443b5 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:08.884474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 815/1645] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:08.886367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:08.887843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.888485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.889010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] PATH_INFO: `/v3/users/1e3861c9f6dd47c8b1d92edc759b587a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.892709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3861c9f6dd47c8b1d92edc759b587a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:08.895876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:08.899456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:08.923107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90e4a-ab5f-41d5-b951-2fd9bb3e2255 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:08.932060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:08.933966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:08.935027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:08.935459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:08.964506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:08.970598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884e7f-05cd-4502-90f6-17b107947f9c service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:08.996257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 816/1646] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:09.011388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3861c9f6dd47c8b1d92edc759b587a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:09.022768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3861c9f6dd47c8b1d92edc759b587a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:09.037026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3861c9f6dd47c8b1d92edc759b587a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:09.038957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3861c9f6dd47c8b1d92edc759b587a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:09.083897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3861c9f6dd47c8b1d92edc759b587a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:09.105342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 831/1647] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:08 2022] DELETE /identity/v3/users/1e3861c9f6dd47c8b1d92edc759b587a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:09.110819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d13fa-a9e8-48ae-9623-98898c14d6c3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:09.111207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d13fa-a9e8-48ae-9623-98898c14d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:09.111692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d13fa-a9e8-48ae-9623-98898c14d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:09.151657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-648d13fa-a9e8-48ae-9623-98898c14d6c3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:09.152737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-648d13fa-a9e8-48ae-9623-98898c14d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:09.260504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 817/1648] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:09.422095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:09.423673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:09.582409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d5e9-5867-4ab3-a34c-e36f2d53e571 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:09.587379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:09.588252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:09.588929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:09.589398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:09.605054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18707-ddb1-499c-a9ea-6d742ecc7d9d None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:09.605617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18707-ddb1-499c-a9ea-6d742ecc7d9d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:09.606039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18707-ddb1-499c-a9ea-6d742ecc7d9d None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:09.607868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 818/1649] 10.222.0.13 () {54 vars in 912 bytes} [Mon May 16 22:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:09.610277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:09.612236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:09.614518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:09.614994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:09.616106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:09.642543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 832/1650] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:09.685071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:09.687764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:09.706992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 819/1651] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:19:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:09.724814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:09.726583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:09.745631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceaab-e7d7-4d9f-9588-f14d1be9f56b service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:09.758204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:09.759975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:09.762032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:09.762334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:09.785838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:09.791660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:09.810535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 833/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:10.888241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:10.890771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.055641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fbce-64c1-4bec-9d18-3decfda4c68b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:11.068743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:11.069481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.069771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.070132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.074923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.078749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:11.080393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.107802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1e94e-069d-4f68-bd9c-55c81e2dc02c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:11.113748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:11.118783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:11.127088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:11.128408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.128858 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.129324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] PATH_INFO: `/v3/projects/99a22be98b7e4f4c859f581f3aeb590d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.130837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a22be98b7e4f4c859f581f3aeb590d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:11.132033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: WARNING py.warnings [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:11.132033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: warnings.warn(msg) May 16 22:19:11.132033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: May 16 22:19:11.133881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:11.149759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 820/1653] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:11.157258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:11.164124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.197372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040e26-a9b0-4877-8739-d935870fa236 service placement] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:11.281075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a22be98b7e4f4c859f581f3aeb590d', 'request_id': 'req-0a64adff-0add-41ef-bc49-da4295428ad3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.281075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a22be98b7e4f4c859f581f3aeb590d', 'request_id': 'req-0a64adff-0add-41ef-bc49-da4295428ad3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.301894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a22be98b7e4f4c859f581f3aeb590d', 'request_id': 'req-0a64adff-0add-41ef-bc49-da4295428ad3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.334006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] The token cache is being invalidate because project 99a22be98b7e4f4c859f581f3aeb590d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:11.334321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.335187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0a64adff-0add-41ef-bc49-da4295428ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.338500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 834/1654] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:11 2022] DELETE /identity/v3/projects/99a22be98b7e4f4c859f581f3aeb590d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:11.344186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9c6e-c99f-40e8-b8d2-8dfbe3270478 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.344528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9c6e-c99f-40e8-b8d2-8dfbe3270478 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.344829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f9c6e-c99f-40e8-b8d2-8dfbe3270478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.372478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:11.373423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.373709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.374021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] PATH_INFO: `/v3/users/0e26b5e1aca149959a14e453cde17f01` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.375523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e26b5e1aca149959a14e453cde17f01)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:11.376589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: WARNING py.warnings [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 22:19:11.376589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: warnings.warn(msg) May 16 22:19:11.376589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: May 16 22:19:11.377899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:11.422677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7a9f9c6e-c99f-40e8-b8d2-8dfbe3270478 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:11.427917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7a9f9c6e-c99f-40e8-b8d2-8dfbe3270478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.458533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 835/1655] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:11.461482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.461878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.462186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.523207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e26b5e1aca149959a14e453cde17f01'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.533823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:11.535989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.536365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e26b5e1aca149959a14e453cde17f01'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.556272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 836/1656] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:11.560752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:11.560969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e26b5e1aca149959a14e453cde17f01'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.566660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e26b5e1aca149959a14e453cde17f01'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.567700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-1d1ca4af-e5b2-47a9-bb80-175e4df59ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e26b5e1aca149959a14e453cde17f01'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:11.586169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4cb81-7462-414a-83c4-babd7deb3693 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:11.599299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:11.599982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.602996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.608450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.609588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:11.612498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:11.614407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:11.648845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 821/1657] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:11 2022] DELETE /identity/v3/users/0e26b5e1aca149959a14e453cde17f01 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:11.650880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.651183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.651452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.657706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 837/1658] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:11.662667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:11.665868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.691793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:11.691793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.716363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd8505-789e-4558-abb7-e810cf60829a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:11.888463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 822/1659] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:11.935515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:11.938065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:11.939762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:11.940071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:11.940999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:11.941911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:11.943556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:11.946796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:11.998234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 838/1660] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:11 2022] POST /identity/v3/projects => generated 381 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:12.004340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.063837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab2ef-e3f3-4409-a952-a101912d3cac None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.097382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d10fe-2f83-4dbe-8f7a-7e3a03ad2d36 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.104297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.105622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.108095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.109153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.112784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.115039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.162320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 839/1661] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:12 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:12.165544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.180129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.180823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.181088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.181389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.186190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da1f32-64f7-4148-849d-c7aad077ad40 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.197872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.199335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.205835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.206524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.206803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.207074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.207818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.209482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.225598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 823/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:12.230273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 840/1663] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:12.231481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.245865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eee98-b969-4807-a998-f7779d422fba service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.263660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.272517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.273011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.273483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.275207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.279258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e2e4-886e-4384-a90c-627d3e06b173 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.309917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 824/1664] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:12.310647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.342481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b41ac-80a2-4fa1-9e51-66a27d017183 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.354996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.356013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.361650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.361937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] PATH_INFO: `/v3/projects/6790b740f33f43b086b3888c296909a8/users/6414bff4340c4321b4ef2f72fc10f0a7/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.402994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6790b740f33f43b086b3888c296909a8, user_id=6414bff4340c4321b4ef2f72fc10f0a7, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.406718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.440283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 841/1665] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:12 2022] PUT /identity/v3/projects/6790b740f33f43b086b3888c296909a8/users/6414bff4340c4321b4ef2f72fc10f0a7/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:19:12.444341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.449945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.450396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.595411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] MFA Rules not processed for user `6414bff4340c4321b4ef2f72fc10f0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:12.596750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:12.770588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 825/1666] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:12.772967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.878217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775260b-b2d7-448c-b691-1438f8a143a2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:12.884405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:12.885332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:12.886012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:12.886918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:12.887385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:12.890743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:12.929391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 842/1667] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:12 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:12.930718 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:12.943725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b348f4f-eee8-4b31-845b-656fddc1998e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.062506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.063214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.063499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.063815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.064467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.066525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:13.096502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 826/1668] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:12 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:13.100223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.114008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89bbd-e8fb-4aeb-94be-8d099fbeeef9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.133293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.133993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.134270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.134698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.135571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.140644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:13.172021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.178503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 843/1669] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:13.182942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dda6-b23a-4040-9a43-42d6d216f339 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.188185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.189406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.189820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.190254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] PATH_INFO: `/v3/projects/0208434c686e4c899a6cf36373dbe23b/users/eef86e291c8c47b99ea730c3822fb009/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.213945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0208434c686e4c899a6cf36373dbe23b, user_id=eef86e291c8c47b99ea730c3822fb009, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.217419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:13.247362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 827/1670] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:13 2022] PUT /identity/v3/projects/0208434c686e4c899a6cf36373dbe23b/users/eef86e291c8c47b99ea730c3822fb009/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:13.248674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.267958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feebabd-3079-4961-bc8e-a397bf1dc808 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.357189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.357915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.358204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.358735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.359643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.361517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56791-0021-4c46-b243-b871c3c436bf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:13.384028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 844/1671] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:13.387022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.404864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740c00-eb92-49a3-93b2-a79185466a51 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.416701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.418127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.419254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.419798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] PATH_INFO: `/v3/projects/0208434c686e4c899a6cf36373dbe23b/users/eef86e291c8c47b99ea730c3822fb009/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.424051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0208434c686e4c899a6cf36373dbe23b, user_id=eef86e291c8c47b99ea730c3822fb009, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.427657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:13.450490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 828/1672] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:13 2022] PUT /identity/v3/projects/0208434c686e4c899a6cf36373dbe23b/users/eef86e291c8c47b99ea730c3822fb009/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:13.463669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.463953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.464398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.537700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] MFA Rules not processed for user `eef86e291c8c47b99ea730c3822fb009`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:13.539236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:13.653142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.655236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:13.701143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 845/1673] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:13.707017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:13.710160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:13.792681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48960-4c7f-4674-8c42-ffb36c4c7a1b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:13.806248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:13.815931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:13.816769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:13.816769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:13.823854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:13.985861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:13.987494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:14.001286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 829/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:14.003683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:14.005470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:14.028342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362e5-1ed4-4c7f-9e36-8265902e512b service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:14.047524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:14.048891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:14.049363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:14.049805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:14.078343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:14.089749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:14.123243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 830/1675] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:14.346840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90027e-d456-44b5-b872-81aef42dcff4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:14.359517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:14.360750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:14.361350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:14.361767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] PATH_INFO: `/v3/projects/e0f8e4eb495e495cae3200ee7f568644` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:14.365687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:14.375490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ab710-b0a3-4ad0-963d-c90c5663b31d service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:14.376193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f8e4eb495e495cae3200ee7f568644)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:14.385052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:14.388554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:14.389234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:14.394688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:14.395098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:14.543972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f8e4eb495e495cae3200ee7f568644', 'request_id': 'req-aa442877-bb6e-4d21-9f85-dfc3f96a524b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.570885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f8e4eb495e495cae3200ee7f568644', 'request_id': 'req-aa442877-bb6e-4d21-9f85-dfc3f96a524b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.579383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:14.580955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:14.587449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f8e4eb495e495cae3200ee7f568644', 'request_id': 'req-aa442877-bb6e-4d21-9f85-dfc3f96a524b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.608012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 831/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:14.619263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] The token cache is being invalidate because project e0f8e4eb495e495cae3200ee7f568644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:14.620095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.622183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.628406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 846/1677] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:13 2022] DELETE /identity/v3/projects/e0f8e4eb495e495cae3200ee7f568644 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:14.632788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:14.651087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5853-2051-49a5-84e2-3554e9771a25 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:14.795579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:14.799604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:14.800081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:14.800889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] PATH_INFO: `/v3/users/83bec30cc62543cf9262fbb98db1092a` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:14.804043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bec30cc62543cf9262fbb98db1092a)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:14.808636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:14.951791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bec30cc62543cf9262fbb98db1092a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.974769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bec30cc62543cf9262fbb98db1092a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.992738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bec30cc62543cf9262fbb98db1092a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.995191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bec30cc62543cf9262fbb98db1092a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:14.996200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-85cd39f0-b2f8-445c-a47f-8b2d27523dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bec30cc62543cf9262fbb98db1092a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:15.027876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 832/1678] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:14 2022] DELETE /identity/v3/users/83bec30cc62543cf9262fbb98db1092a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:16.798542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:16.800666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:16.822950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa442877-bb6e-4d21-9f85-dfc3f96a524b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:16.973933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:16.975954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:16.976246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:16.976527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] PATH_INFO: `/v3/projects/e4e41c8bb905451488d4e3896bb605cd` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:16.979806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e41c8bb905451488d4e3896bb605cd)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:16.986189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:17.102336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e41c8bb905451488d4e3896bb605cd', 'request_id': 'req-6bff110d-f623-4b78-a5f2-4580fc8911e4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:17.122313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e41c8bb905451488d4e3896bb605cd', 'request_id': 'req-6bff110d-f623-4b78-a5f2-4580fc8911e4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:17.129183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e41c8bb905451488d4e3896bb605cd', 'request_id': 'req-6bff110d-f623-4b78-a5f2-4580fc8911e4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:17.150609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] The token cache is being invalidate because project e4e41c8bb905451488d4e3896bb605cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:17.150912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:17.152457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6bff110d-f623-4b78-a5f2-4580fc8911e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:17.157835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 847/1679] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:16 2022] DELETE /identity/v3/projects/e4e41c8bb905451488d4e3896bb605cd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:17.160205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.160686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.160769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.219074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:17.220307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:17.349920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 833/1680] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:17.359447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.359447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.359640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.398434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:17.400109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:17.420893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 848/1681] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:17.425518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:17.436324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67032b3-6639-4cd9-9d4f-0202cea2d19c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:17.458306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:17.459000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.459282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.459815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.461034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:17.461374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:17.463414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:17.482225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 834/1682] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:19:17.488271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:17.502416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a44a8e-5e38-46e7-a14e-4627ed3b59f4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:17.521922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:17.523586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.525627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.526070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.527021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:17.532666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:17.626143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:17.640266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 849/1683] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:17.641457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f4752-b75d-4fe4-84d9-9c026b5daaed admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:17.812096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:17.812807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.813091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.813400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.818498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:17.826468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:17.870006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 835/1684] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:17 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:17.874917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:17.889029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aa734-29c4-4693-93e2-84b7f31e0d45 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:17.946961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:17.947674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:17.947966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:17.948236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:17.948984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:17.955865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:17.990657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 850/1685] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:17.993894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.011185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1206d9f-6e82-4775-9177-2306e2d6d8ab admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.048152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.056927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.057669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.058122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.059050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.062567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a9a4b-0747-4a24-9703-6def5a1ff266 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.103449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 836/1686] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:18.105608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.122527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d321a-441b-46ff-b81d-499ca024c512 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.145904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.147188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.147629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.148063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] PATH_INFO: `/v3/projects/3a2a0ef6125d40cf9dedd56836819008/users/fb6a6f25519f4201b2d099b8e30d8a88/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.173528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2a0ef6125d40cf9dedd56836819008, user_id=fb6a6f25519f4201b2d099b8e30d8a88, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.179353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.201401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 851/1687] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:18 2022] PUT /identity/v3/projects/3a2a0ef6125d40cf9dedd56836819008/users/fb6a6f25519f4201b2d099b8e30d8a88/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:18.212562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.213727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.214150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.260977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] MFA Rules not processed for user `fb6a6f25519f4201b2d099b8e30d8a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:18.262999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:18.375446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 837/1688] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:18.379563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.475233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6811-abb2-4330-aba0-361f0ad8b2c4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.480736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.481449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.481735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.482010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.483455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.485455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.535242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 852/1689] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:18 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:18.536427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.553618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acd16-4646-4b3a-86b2-440bc5aa932a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.694788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.696552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.697144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.697707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.698896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.701743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.746428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 838/1690] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:18 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:18.748030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.766731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636fc1-308e-4738-91ec-34a48af604f7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.777153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.779462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.779754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.780065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.783424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.786189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.816714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.817807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 853/1691] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:18.836072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094316-b5ab-4cff-b93d-4758b5a2b59f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:18.842750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:18.843676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:18.843967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:18.844248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] PATH_INFO: `/v3/projects/9c540ef45d484a6394c041b27ee2d2be/users/6a0543810707469a86ee71ea777eeb45/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:18.886996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c540ef45d484a6394c041b27ee2d2be, user_id=6a0543810707469a86ee71ea777eeb45, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:18.893084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:18.927983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 839/1692] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:18 2022] PUT /identity/v3/projects/9c540ef45d484a6394c041b27ee2d2be/users/6a0543810707469a86ee71ea777eeb45/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:18.932285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:18.945540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f6197-4d49-416e-ad24-e49949f76846 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:19.026167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:19.027301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.027729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.028153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:19.030395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:19.032195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255818e7-a6da-47b2-bf4b-70a72e7fcac6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:19.051336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:19.058639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 854/1693] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:19.065570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39576-d4d3-4e9a-b6c4-1857a04f1dae admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:19.071839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:19.073191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.073729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.074434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] PATH_INFO: `/v3/projects/9c540ef45d484a6394c041b27ee2d2be/users/6a0543810707469a86ee71ea777eeb45/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:19.078817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c540ef45d484a6394c041b27ee2d2be, user_id=6a0543810707469a86ee71ea777eeb45, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:19.083104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:19.114993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ded3e9-386d-4acc-8887-758b24333d3e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.118679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ded3e9-386d-4acc-8887-758b24333d3e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.119455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ded3e9-386d-4acc-8887-758b24333d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:19.121674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 840/1694] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:19 2022] PUT /identity/v3/projects/9c540ef45d484a6394c041b27ee2d2be/users/6a0543810707469a86ee71ea777eeb45/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:19.153730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-39ded3e9-386d-4acc-8887-758b24333d3e None None] MFA Rules not processed for user `6a0543810707469a86ee71ea777eeb45`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:19.155875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-39ded3e9-386d-4acc-8887-758b24333d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:19.290010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 855/1695] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:19.337734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:19.339552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:19.508447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb091731-1bf8-455c-9df8-731a30566574 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:19.525699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:19.526403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.526692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.526971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:19.552040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:19.553566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:19.576030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 841/1696] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:19.731353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.731540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.732642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:19.823969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:19.824457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:19.849112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:19.866591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fa01a-2f09-49b1-a3e2-31bfe21ed6a0 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:19.890504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:19.891618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:19.892061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:19.892505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:20.000240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 856/1697] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:20.170441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:20.172090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79532d-2ecc-4dc1-9b1e-d888ab97af80 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:20.205984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 842/1698] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:20.342438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:20.343884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:20.490024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533052d4-aaf8-483c-8843-195173f6bf6b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:20.515634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:20.516342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:20.516642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:20.516899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:20.541585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:20.543485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40e83-9192-47f1-ba0a-df36fe05d9cf service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:20.562196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 857/1699] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:19:20.660898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:20.661073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f7d2-879a-4f6e-bfbd-b9723a0e0edf None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:20.661662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:20.661732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f7d2-879a-4f6e-bfbd-b9723a0e0edf None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:20.661824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:20.661922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f7d2-879a-4f6e-bfbd-b9723a0e0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:20.760613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] MFA Rules not processed for user `de089161e46349db878d6d12d1fc3d42`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:20.762227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:20.829514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-eb65f7d2-879a-4f6e-bfbd-b9723a0e0edf None None] MFA Rules not processed for user `6d960067f49b43a7bd26af6c0a20d369`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:20.845319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-eb65f7d2-879a-4f6e-bfbd-b9723a0e0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:21.008218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 858/1700] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:21.030363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:21.032181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:21.212713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2dcc5-295e-4f8a-9d6d-a104832e8ed0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:21.224609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:21.225531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:21.226019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:21.226491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:21.235795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:21.237779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:21.240840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 843/1701] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 581 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:21.259634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345221-df75-4061-8a75-219f357dbb8c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:21.260024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345221-df75-4061-8a75-219f357dbb8c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:21.261460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345221-df75-4061-8a75-219f357dbb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:21.267386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 859/1702] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:21.359392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-11345221-df75-4061-8a75-219f357dbb8c None None] MFA Rules not processed for user `6d960067f49b43a7bd26af6c0a20d369`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:21.362122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-11345221-df75-4061-8a75-219f357dbb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:21.405320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 844/1703] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:21.440031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:21.461169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029925f3-8a73-4824-9fc4-41a7dc3c481f service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:21.480430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:21.481606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:21.482027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:21.482435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:21.500302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:21.503623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:21.572375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 860/1704] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:23.054005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:23.054496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:23.054593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:23.112663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:23.118183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:23.383071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 845/1705] 10.222.0.61 () {58 vars in 1015 bytes} [Mon May 16 22:19:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:23.486544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:23.489191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:23.527387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c54f8-3f5d-403d-98d7-a53ab10f8573 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:23.534798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:23.535467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:23.535753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:23.536146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:23.546289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:23.547688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806d95c-874e-43dc-9633-4995a9395b85 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:23.565667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 861/1706] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:23.602222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:23.604119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:23.818896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dabdcb-f3c7-4e52-b084-dcdd084e13da None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:23.837164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:23.838893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:23.839329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:23.839760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] PATH_INFO: `/v3/users/db13a3e0bbfc41788ffce6ec0627a14d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:23.841974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db13a3e0bbfc41788ffce6ec0627a14d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:23.848331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:23.978580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db13a3e0bbfc41788ffce6ec0627a14d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:24.002329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db13a3e0bbfc41788ffce6ec0627a14d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:24.016347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db13a3e0bbfc41788ffce6ec0627a14d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:24.017796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db13a3e0bbfc41788ffce6ec0627a14d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:24.019074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b786c95c-919c-412a-b615-0ef4d9735b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db13a3e0bbfc41788ffce6ec0627a14d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:24.066867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 846/1707] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:23 2022] DELETE /identity/v3/users/db13a3e0bbfc41788ffce6ec0627a14d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:24.068843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:24.069254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:24.069522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:24.100552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:24.102089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:24.395570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 862/1708] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:24.463391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:24.463995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:24.464413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:24.468126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:24.469760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:24.555759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] MFA Rules not processed for user `3d32a8df74c74851adf017d2132ad13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:24.557011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:24.704515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5cab5-6989-4322-982c-05df667ea733 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:24.725981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:24.726667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:24.726957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:24.727235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:24.768714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:24.771601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a92a2-56d9-4e68-bc2a-d8226001865d service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:24.812874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 863/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:24.816374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:24.817532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:24.818266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:24.828701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 847/1710] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:24.842497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:24.844729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:24.917531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] MFA Rules not processed for user `6d960067f49b43a7bd26af6c0a20d369`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:24.926058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:25.199611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a21dc4-181b-4ce2-9231-2b1f4ae19dec None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:25.214825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 864/1711] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:25.229702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:25.230380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:25.230665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:25.230934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:25.273017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:25.274684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036f30-a7ba-40d3-83d6-835e91a24399 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:25.325960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 848/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:26.008482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:26.015307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:26.039223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58b94-fbcd-49bc-a2eb-eb9145749fec None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:26.047956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:26.053713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:26.054235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:26.054670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] PATH_INFO: `/v3/users/fb6a6f25519f4201b2d099b8e30d8a88` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:26.056862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6a6f25519f4201b2d099b8e30d8a88)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:26.061709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:26.168107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6a6f25519f4201b2d099b8e30d8a88'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:26.182486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6a6f25519f4201b2d099b8e30d8a88'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:26.198000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6a6f25519f4201b2d099b8e30d8a88'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:26.199191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6a6f25519f4201b2d099b8e30d8a88'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:26.229240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6a6f25519f4201b2d099b8e30d8a88'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:26.252045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 865/1713] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:26 2022] DELETE /identity/v3/users/fb6a6f25519f4201b2d099b8e30d8a88 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:26.257370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:26.258228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:26.258645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:26.296827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:26.298354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:26.477154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 849/1714] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:26.862170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:26.868328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:27.001628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12766d-95e1-47ab-98fa-c5f7b691fdca admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:27.008750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:27.012688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.013170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.013652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.027409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:27.031914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf501d-ef63-4d08-b029-24e5248b4a75 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:27.066908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 866/1715] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:27.206405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:27.208519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:27.240900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986deb5a-b4e1-4444-bcda-21bf357d1000 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:27.259368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:27.261441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.263727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.264043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] PATH_INFO: `/v3/projects/d26fdbe69d80411d9cc8c1cbe579a6da` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.267320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26fdbe69d80411d9cc8c1cbe579a6da)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:27.269290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:27.381336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26fdbe69d80411d9cc8c1cbe579a6da', 'request_id': 'req-8f78b268-0fdc-4804-b8e2-a58725f50350'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:27.391423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26fdbe69d80411d9cc8c1cbe579a6da', 'request_id': 'req-8f78b268-0fdc-4804-b8e2-a58725f50350'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:27.422640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26fdbe69d80411d9cc8c1cbe579a6da', 'request_id': 'req-8f78b268-0fdc-4804-b8e2-a58725f50350'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:27.451427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] The token cache is being invalidate because project d26fdbe69d80411d9cc8c1cbe579a6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:27.452031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:27.498156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f78b268-0fdc-4804-b8e2-a58725f50350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:27.508751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 850/1716] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:27 2022] DELETE /identity/v3/projects/d26fdbe69d80411d9cc8c1cbe579a6da => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:27.514041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.515122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.515601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.554390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:27.555681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:27.729553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 867/1717] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:27.739994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.740514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.741128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.775575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:27.780575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:27.814074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 851/1718] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:27.818350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:27.842239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3c5a4-fd0d-423c-a8f3-d722de37ac94 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:27.852741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:27.854937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.856521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.856955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.860606 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:27.861246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:27.864014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:27.895934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 868/1719] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:27.900225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:27.914243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014575-ba8f-4ae8-91e6-b814541c847b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:27.924758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:27.925748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:27.926167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:27.926550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:27.927385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:27.931034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:27.988188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 852/1720] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:27 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:27.992499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:28.008541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88a6e6-2a8d-40c9-b025-ca8fa8570702 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:28.179764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:28.181427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:28.182011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:28.182542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:28.183465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:28.186586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:28.263556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 869/1721] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:27 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:28.267665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:28.282211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc42f0-487e-424d-b42c-22ba95fbf227 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:28.299588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:28.300703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:28.301465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:28.302025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:28.303273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:28.308202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:28.337698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 853/1722] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:28.350709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:28.369279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0edce-5ba1-4526-8217-e1a15949ff39 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:28.376697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:28.378014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:28.378614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:28.379101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:28.380188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:28.384448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e918ea-c97f-4f16-8df3-7b310760a925 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:28.426617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 870/1723] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:28.427443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:28.440642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d24a-4919-4924-8fc3-a38385bc6eea admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:28.456242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:28.461009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:28.461685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:28.462360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] PATH_INFO: `/v3/projects/85780b85646b4ef3b3e066a214caf5be/users/6ab040d91be844b790f6223edbdb1d01/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:28.576318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85780b85646b4ef3b3e066a214caf5be, user_id=6ab040d91be844b790f6223edbdb1d01, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:28.606401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:28.655586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 854/1724] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:28 2022] PUT /identity/v3/projects/85780b85646b4ef3b3e066a214caf5be/users/6ab040d91be844b790f6223edbdb1d01/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:28.672369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:28.673068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:28.673702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:28.777690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] MFA Rules not processed for user `6ab040d91be844b790f6223edbdb1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:28.779270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:29.042595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 871/1725] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:29.054389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:29.056862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:29.405743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0383d-84ac-4e89-aa4e-f1a9b6fcb360 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:29.434646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:29.437618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:29.437951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:29.438362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:29.471999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:29.477297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:29.526054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 855/1726] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:31.300540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:31.302006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:31.345639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:31.347230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:31.625577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b10c-e6c2-4703-ad25-d9f809dc4ba6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:31.625773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f490304-fc70-418a-b1c0-c1f6aca0756e service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:31.639259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:31.640296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:31.640812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:31.641258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] PATH_INFO: `/v3/projects/3a2a0ef6125d40cf9dedd56836819008` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:31.651870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:31.655187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:31.656730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:31.658463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] PATH_INFO: `/v3/users/6414bff4340c4321b4ef2f72fc10f0a7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:31.661310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2a0ef6125d40cf9dedd56836819008)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:31.662838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6414bff4340c4321b4ef2f72fc10f0a7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:31.669494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:31.671924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:31.814808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6414bff4340c4321b4ef2f72fc10f0a7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.840396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6414bff4340c4321b4ef2f72fc10f0a7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.854937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6414bff4340c4321b4ef2f72fc10f0a7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.855900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6414bff4340c4321b4ef2f72fc10f0a7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.892938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a087411-90fd-4439-a97f-1615418415f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6414bff4340c4321b4ef2f72fc10f0a7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.913196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 872/1727] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:31 2022] DELETE /identity/v3/users/6414bff4340c4321b4ef2f72fc10f0a7 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:31.917961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ac53-b699-4448-a784-704904f30385 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:31.919049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ac53-b699-4448-a784-704904f30385 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:31.921020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4ac53-b699-4448-a784-704904f30385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:31.960184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2a0ef6125d40cf9dedd56836819008', 'request_id': 'req-6ca639c4-b011-4d49-86f6-ca2b51c5809e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:31.978968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8db4ac53-b699-4448-a784-704904f30385 None None] MFA Rules not processed for user `de089161e46349db878d6d12d1fc3d42`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:31.980566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8db4ac53-b699-4448-a784-704904f30385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:31.995629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2a0ef6125d40cf9dedd56836819008', 'request_id': 'req-6ca639c4-b011-4d49-86f6-ca2b51c5809e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.010610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2a0ef6125d40cf9dedd56836819008', 'request_id': 'req-6ca639c4-b011-4d49-86f6-ca2b51c5809e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.055305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] The token cache is being invalidate because project 3a2a0ef6125d40cf9dedd56836819008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:32.057645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.063793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6ca639c4-b011-4d49-86f6-ca2b51c5809e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.066479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 856/1728] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:31 2022] DELETE /identity/v3/projects/3a2a0ef6125d40cf9dedd56836819008 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:32.068073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d37d-433d-4133-9c2b-81dfa9c332c0 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.068584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d37d-433d-4133-9c2b-81dfa9c332c0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.069072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d37d-433d-4133-9c2b-81dfa9c332c0 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.070712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 857/1729] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:32.085910 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5681-69f1-4f93-be17-5944f741e512 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.086561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5681-69f1-4f93-be17-5944f741e512 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.087056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a5681-69f1-4f93-be17-5944f741e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.127332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8d0a5681-69f1-4f93-be17-5944f741e512 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:32.128709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8d0a5681-69f1-4f93-be17-5944f741e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.176083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 873/1730] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:32.176083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4ac53-b699-4448-a784-704904f30385 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:32.177009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8db4ac53-b699-4448-a784-704904f30385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.277319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 858/1731] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:32.279008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.279500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.280808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.324975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4ac53-b699-4448-a784-704904f30385 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:32.331965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:32.332989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.333465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.333746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] PATH_INFO: `/v3/users/6a0543810707469a86ee71ea777eeb45` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.334996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0543810707469a86ee71ea777eeb45)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:32.336959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:32.338935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:32.346835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.458998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0543810707469a86ee71ea777eeb45'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.474733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0543810707469a86ee71ea777eeb45'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.482832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 859/1732] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:19:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:32.483939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:32.486705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.502168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0543810707469a86ee71ea777eeb45'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.503198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0543810707469a86ee71ea777eeb45'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.536966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0543810707469a86ee71ea777eeb45'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:32.549649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 874/1733] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:32 2022] DELETE /identity/v3/users/6a0543810707469a86ee71ea777eeb45 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:32.562761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5ff1b-f465-4162-a837-00f54bdf0bf3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:32.646071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:32.647737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.678480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:32.681182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.681487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.681843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.686095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.802025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:32.802230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6517e6-0490-4be0-b64e-68ac27f5cd49 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:32.851085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 860/1734] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:32.865989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ede04-9c05-468c-a1f8-fe52952098a9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:32.867679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc66a0-e878-4b87-8dc0-5ade355a8e46 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.868207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc66a0-e878-4b87-8dc0-5ade355a8e46 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.868443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc66a0-e878-4b87-8dc0-5ade355a8e46 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.870265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 861/1735] 10.222.0.13 () {54 vars in 912 bytes} [Mon May 16 22:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:32.887635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:32.888505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.888677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:32.888775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.889666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.890164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:32.890574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:32.896782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.927345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:32.929386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:32.931438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:32.932656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:32.947453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 875/1736] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:32.966645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 862/1737] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:19:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:33.057818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:33.061792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:33.078057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163cc9c-bc8e-4fe6-b8b0-752cfa66b327 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:33.091556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:33.097386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:33.098413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:33.102408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:33.119875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:33.122736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:33.148503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 876/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:33.438145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:33.440683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:33.460328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a885c9-b375-4f9a-82e5-4f43a2969961 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:33.468579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:33.469662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:33.470719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:33.470719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] PATH_INFO: `/v3/projects/6790b740f33f43b086b3888c296909a8` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:33.472328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6790b740f33f43b086b3888c296909a8)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:33.474721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:33.673766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6790b740f33f43b086b3888c296909a8', 'request_id': 'req-5cae927b-0393-41d0-af7f-9e5ce70de8c2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:33.683487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6790b740f33f43b086b3888c296909a8', 'request_id': 'req-5cae927b-0393-41d0-af7f-9e5ce70de8c2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:33.697438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6790b740f33f43b086b3888c296909a8', 'request_id': 'req-5cae927b-0393-41d0-af7f-9e5ce70de8c2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:33.711498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] The token cache is being invalidate because project 6790b740f33f43b086b3888c296909a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:33.711796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:33.712467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:33.714376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 863/1739] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:33 2022] DELETE /identity/v3/projects/6790b740f33f43b086b3888c296909a8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:33.718651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:33.734353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7256543-6fae-4a1f-be1a-ac7acd22ecac service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:33.923862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:33.924666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:33.924941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:33.925234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] PATH_INFO: `/v3/users/eef86e291c8c47b99ea730c3822fb009` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:33.926489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef86e291c8c47b99ea730c3822fb009)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:33.928468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:34.060994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef86e291c8c47b99ea730c3822fb009'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.090153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef86e291c8c47b99ea730c3822fb009'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.106652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef86e291c8c47b99ea730c3822fb009'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.108736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef86e291c8c47b99ea730c3822fb009'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.129860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef86e291c8c47b99ea730c3822fb009'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.138571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 877/1740] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:33 2022] DELETE /identity/v3/users/eef86e291c8c47b99ea730c3822fb009 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:34.552065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:34.554281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:34.583823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae927b-0393-41d0-af7f-9e5ce70de8c2 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:34.689507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:34.690955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:34.782542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:34.783902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:34.784255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:34.784507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] PATH_INFO: `/v3/projects/9c540ef45d484a6394c041b27ee2d2be` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:34.789147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c540ef45d484a6394c041b27ee2d2be)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:34.796567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:34.894673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65438-bd2e-4af8-b961-e5d64967d55a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:34.916198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:34.917526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:34.917957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:34.919352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] PATH_INFO: `/v3/projects/0208434c686e4c899a6cf36373dbe23b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:34.921617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0208434c686e4c899a6cf36373dbe23b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:34.923844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:34.978644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c540ef45d484a6394c041b27ee2d2be', 'request_id': 'req-5fa4a9b1-a2d7-4570-b38a-336db7217961'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:34.995484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c540ef45d484a6394c041b27ee2d2be', 'request_id': 'req-5fa4a9b1-a2d7-4570-b38a-336db7217961'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.015422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0208434c686e4c899a6cf36373dbe23b', 'request_id': 'req-f6f00f7d-076a-4f8f-8457-d097702afee3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.022280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c540ef45d484a6394c041b27ee2d2be', 'request_id': 'req-5fa4a9b1-a2d7-4570-b38a-336db7217961'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.033878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0208434c686e4c899a6cf36373dbe23b', 'request_id': 'req-f6f00f7d-076a-4f8f-8457-d097702afee3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.045811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] The token cache is being invalidate because project 9c540ef45d484a6394c041b27ee2d2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:35.046321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.050020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5fa4a9b1-a2d7-4570-b38a-336db7217961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.050322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0208434c686e4c899a6cf36373dbe23b', 'request_id': 'req-f6f00f7d-076a-4f8f-8457-d097702afee3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.054332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 864/1741] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:34 2022] DELETE /identity/v3/projects/9c540ef45d484a6394c041b27ee2d2be => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:35.066752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6702-96cc-4308-bdea-994a2f584dde None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.066752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6702-96cc-4308-bdea-994a2f584dde None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.070691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6702-96cc-4308-bdea-994a2f584dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.091083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] The token cache is being invalidate because project 0208434c686e4c899a6cf36373dbe23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:35.092538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.095505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f6f00f7d-076a-4f8f-8457-d097702afee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:35.101936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 878/1742] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:34 2022] DELETE /identity/v3/projects/0208434c686e4c899a6cf36373dbe23b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:19:35.103381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7195c-a81e-4293-a0dd-87ac4641373c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.103664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7195c-a81e-4293-a0dd-87ac4641373c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.103938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7195c-a81e-4293-a0dd-87ac4641373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.150747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-60fa6702-96cc-4308-bdea-994a2f584dde None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:35.151898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-60fa6702-96cc-4308-bdea-994a2f584dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:35.182433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a2b7195c-a81e-4293-a0dd-87ac4641373c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:35.183987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a2b7195c-a81e-4293-a0dd-87ac4641373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:35.386810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 865/1743] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:35.389507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.389803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.390095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.425030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 879/1744] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:35.437767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.438363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.439042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.446428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:35.447773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:35.463224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 866/1745] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:35.468290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:35.485564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44607-84f2-4ab0-b88d-96aa3dda135c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:35.495620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:35.496851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.497230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.497602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.498519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:35.501063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:35.506024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:35.507043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:35.511195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:35.560071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 880/1746] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:35.562720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:35.567211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 867/1747] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:35.574196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:35.629823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f36d-a1b2-413c-a202-601e0e074119 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:35.646085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fce93-fbcb-4a36-abd8-45aeb8f622af admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:35.655626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:35.656371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.659378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.659683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.665828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:35.667665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:35.668211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:35.673477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.676073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.678209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.679658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:35.683457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:35.694790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:35.734198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 881/1748] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:35.739601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:35.769367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7872a-fcc4-4b0f-a0d6-45adc7b5ce72 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:35.795172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 868/1749] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/projects => generated 399 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:35.795555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:35.801237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:35.801566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:35.801566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:35.801566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:35.801566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:35.805458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:35.901748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 882/1750] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:35.905430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.019011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f52b23-9e5a-442d-9afe-252a15971085 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.021926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3109-38f2-410c-aad5-dd78d75a1add admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.028133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.028133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.028133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.028133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.028515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.029637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.032283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.033014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.033668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.050535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.053322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.060459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.117667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 869/1751] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/users => generated 300 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:36.122776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.127880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 883/1752] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:35 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:36.141628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.144135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8508e0-c73d-481a-bb61-050a3b00a191 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.158427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.159196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.159584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.159970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.160757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.162841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.168604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1729f2e-1d68-4592-88fe-bf2ab9a36fff admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.182567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.183390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.183515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.184079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.186338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.188210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 870/1753] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:36.194323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.195434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.211960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78812aa9-319f-46db-928a-d4dc81ad7121 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.234474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.235410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.235763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.236146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.236946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.238354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 884/1754] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:36.241694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.242072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f12ec-640e-4ad2-bcc3-dfe545fb1d58 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.247516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.271264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 871/1755] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:36.271264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.271264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.271264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.274942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69076c1-e434-4196-a535-ce5ae3754d9e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.283735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.284639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.284933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.285301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] PATH_INFO: `/v3/users/6ab040d91be844b790f6223edbdb1d01` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.286877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab040d91be844b790f6223edbdb1d01)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.289031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.377350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab040d91be844b790f6223edbdb1d01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:36.395501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab040d91be844b790f6223edbdb1d01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:36.415085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab040d91be844b790f6223edbdb1d01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:36.416481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab040d91be844b790f6223edbdb1d01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:36.461981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab040d91be844b790f6223edbdb1d01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:36.465654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] MFA Rules not processed for user `3d32a8df74c74851adf017d2132ad13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:36.468049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.480605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 885/1756] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:36 2022] DELETE /identity/v3/users/6ab040d91be844b790f6223edbdb1d01 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:36.482641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.485270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.611671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af56b-a249-4860-9ffa-baad9b55cda5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.617529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 872/1757] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:36.620021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.621139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.622513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.623252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.623686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.624975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.625779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.627602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ffffb-9add-47d5-859d-a0bb1ccaa046 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.644003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 886/1758] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:36.644208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be9bb3-dbe5-487c-ba3f-5a6ad6cb06ec None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.644312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.644312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.644312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.648284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.649324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.649730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.650265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] PATH_INFO: `/v3/projects/87b097c3c0804d97aaba83ae2d3aea6b/users/50fed350b740410aa85140b463d6abec/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.669604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:36.671454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.674784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b097c3c0804d97aaba83ae2d3aea6b, user_id=50fed350b740410aa85140b463d6abec, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.678340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.683684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 887/1759] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:36.686398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.699024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae73f-7682-4eb0-8625-916c0ca4ff16 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.708988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 873/1760] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:36 2022] PUT /identity/v3/projects/87b097c3c0804d97aaba83ae2d3aea6b/users/50fed350b740410aa85140b463d6abec/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:36.720926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:36.722786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.777510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.778407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.778710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.778992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] PATH_INFO: `/v3/projects/9f29c47a6792425db5a68f971af8ad4e/users/899d42e2b96743478b92fd7f97245e5f/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.783896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b60fae-5953-4765-82c3-830c260017c1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:36.787591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:36.788326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.788761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.788951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.793429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f29c47a6792425db5a68f971af8ad4e, user_id=899d42e2b96743478b92fd7f97245e5f, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.796141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab4c65-b927-454d-81ff-fac863bcc5bd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.804361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:36.805963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28746f2d-ec37-4af5-af8c-0368f214e487 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:36.814718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 888/1761] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:36 2022] PUT /identity/v3/projects/9f29c47a6792425db5a68f971af8ad4e/users/899d42e2b96743478b92fd7f97245e5f/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:36.816118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.816414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.816690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.831841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 874/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:36.840569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:36.841413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:36.842073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:36.856445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] MFA Rules not processed for user `50fed350b740410aa85140b463d6abec`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:36.858466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.908698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] MFA Rules not processed for user `899d42e2b96743478b92fd7f97245e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:36.909979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:36.948101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 889/1763] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:36.953594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.016533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 875/1764] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:37.021555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.037808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88872e8-6d12-47c0-97ae-6d090cd0afdf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.045645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.046600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.047442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.047912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.048817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.051128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.090159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 890/1765] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:36 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:37.099551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.127516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65504a-2fd3-41a0-bd88-6be7f45d24a0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.217978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985f009-64de-4a10-9dea-ec42e098577e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.219581 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.220406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.220619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.221096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.222036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.222907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.223582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.224104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.224335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.224448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.225126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.227388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.259586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 891/1766] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:37 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:37.262626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.278192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a2a10-5373-4990-bdd6-f335b71c5533 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.282494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 876/1767] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:37 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:37.283611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.371853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.372557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.372874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.373175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.373942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.375570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.391034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 892/1768] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:37.395218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.406527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682ca3-5f3d-4857-91d3-b0b8bb1dea65 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.407435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502f7fe-c07a-43a3-b3c8-1057b6b2f670 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.413655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.414588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.414877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.415156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] PATH_INFO: `/v3/projects/0b4d83b82670417687ec564e9823ba1c/users/2bf2f6e91aa444aaaa11e0ee547313ff/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.421938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.422781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.422901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.423174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.423877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.430865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.435914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4d83b82670417687ec564e9823ba1c, user_id=2bf2f6e91aa444aaaa11e0ee547313ff, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.440895 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.462768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 893/1769] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:37 2022] PUT /identity/v3/projects/0b4d83b82670417687ec564e9823ba1c/users/2bf2f6e91aa444aaaa11e0ee547313ff/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:37.474452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.513246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 877/1770] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:37 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:37.532633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.567450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a20ef3-19b5-40b8-8f03-1066bdbfa45c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.596079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e24cf-525b-46c1-98f3-e528bbb1ec20 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.602693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.603560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.603983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.604403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.605335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.607359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.620188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 894/1771] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:37.624626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.638581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e216811-dfd1-41dc-ace9-2307309f1cbc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.645516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.646639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.647021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.647399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] PATH_INFO: `/v3/projects/0b4d83b82670417687ec564e9823ba1c/users/2bf2f6e91aa444aaaa11e0ee547313ff/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.649876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4d83b82670417687ec564e9823ba1c, user_id=2bf2f6e91aa444aaaa11e0ee547313ff, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.659057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.660271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.660973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.661283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.661567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.662313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.663942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b0bbc-0762-4170-8a1e-ad7ff15a580b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.675115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 878/1773] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:37.675333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 895/1773] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:37 2022] PUT /identity/v3/projects/0b4d83b82670417687ec564e9823ba1c/users/2bf2f6e91aa444aaaa11e0ee547313ff/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:37.679951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.685768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.686057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.686343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.717561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] MFA Rules not processed for user `2bf2f6e91aa444aaaa11e0ee547313ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:37.718906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:37.808669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 879/1774] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:37.818176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.819587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:37.819831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab242b-4b22-46c4-a5e2-0c27f18de42a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:37.838516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:37.839726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:37.840011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:37.840994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] PATH_INFO: `/v3/projects/b08b2b66838541d9a1494dfc1b751bac/users/65c480b9064b4d9387281a318e9da542/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:37.888077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08b2b66838541d9a1494dfc1b751bac, user_id=65c480b9064b4d9387281a318e9da542, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:37.895675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:37.923271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 896/1775] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:37 2022] PUT /identity/v3/projects/b08b2b66838541d9a1494dfc1b751bac/users/65c480b9064b4d9387281a318e9da542/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:37.929950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:37.948713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208523f-c142-45a3-b71d-9232c41c6e4f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.016959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a116b-6d4c-449f-85dd-bfce2aa794a1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.022721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.023520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.023912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.024293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.025753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.028940 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.041029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 897/1776] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:38.042075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.045096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.062167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b1ca-6236-48d1-8939-8b782a730408 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.065706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.066626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.067030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.067471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.067904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.068931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.069247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.069527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] PATH_INFO: `/v3/projects/85780b85646b4ef3b3e066a214caf5be` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.071058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85780b85646b4ef3b3e066a214caf5be)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.073162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.143440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85780b85646b4ef3b3e066a214caf5be', 'request_id': 'req-86f287d8-0b3a-489c-a335-26a17049d950'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:38.151470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85780b85646b4ef3b3e066a214caf5be', 'request_id': 'req-86f287d8-0b3a-489c-a335-26a17049d950'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:38.158767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85780b85646b4ef3b3e066a214caf5be', 'request_id': 'req-86f287d8-0b3a-489c-a335-26a17049d950'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:38.166352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.168518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c168f-d500-4606-9d7b-168728dacd76 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.176060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] The token cache is being invalidate because project 85780b85646b4ef3b3e066a214caf5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:38.177709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:38.178607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:38.181132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 898/1777] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:38 2022] DELETE /identity/v3/projects/85780b85646b4ef3b3e066a214caf5be => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:38.182376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.183837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.186863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 880/1778] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:38.188483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a1ec-f688-4b46-8dcc-2dbfa161f02e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.188954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a1ec-f688-4b46-8dcc-2dbfa161f02e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.189434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939a1ec-f688-4b46-8dcc-2dbfa161f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.213456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6939a1ec-f688-4b46-8dcc-2dbfa161f02e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:38.214774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6939a1ec-f688-4b46-8dcc-2dbfa161f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.303080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f287d8-0b3a-489c-a335-26a17049d950 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.308868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.310497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.310921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.311298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] PATH_INFO: `/v3/projects/b08b2b66838541d9a1494dfc1b751bac/users/65c480b9064b4d9387281a318e9da542/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.313984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08b2b66838541d9a1494dfc1b751bac, user_id=65c480b9064b4d9387281a318e9da542, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.316894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd400b6-dfde-47c9-b776-05a67b967ee1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.327828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 881/1779] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:38.339339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 899/1780] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:38 2022] PUT /identity/v3/projects/b08b2b66838541d9a1494dfc1b751bac/users/65c480b9064b4d9387281a318e9da542/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:38.339710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c621a3-d5d3-4372-b406-17153e261903 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.339710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c621a3-d5d3-4372-b406-17153e261903 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.339710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c621a3-d5d3-4372-b406-17153e261903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.341521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a440c69-be5f-417a-8acb-8df11d2b7c56 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.342853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a440c69-be5f-417a-8acb-8df11d2b7c56 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.343388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a440c69-be5f-417a-8acb-8df11d2b7c56 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.345810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 900/1781] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:19:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:38.347166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.347166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.347472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.377456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-45c621a3-d5d3-4372-b406-17153e261903 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:38.378703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-45c621a3-d5d3-4372-b406-17153e261903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.406340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] MFA Rules not processed for user `65c480b9064b4d9387281a318e9da542`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:38.407580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.479468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 882/1782] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:38.487633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.487928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.488205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.557911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 901/1783] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:38.557911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.557911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.571928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:38.573100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.631550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f804-6f63-4f17-8b53-e256639f4596 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.635558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.636483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.636796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.637182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.652766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.778849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 883/1784] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:19:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:38.779793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.782329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.787715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.821917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a68e1a-2b43-4664-93f8-33a93154c8a4 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.830791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 902/1785] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:38.835493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.840863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:38.851489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.858157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.858157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.858462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.859196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:38.861503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.863446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.909544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a45da-e4df-4d6d-95e9-2594cab28b46 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.910617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 884/1786] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:38.911552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:38.920795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.921667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.921960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.922234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.928040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f381ce-e0eb-463f-ae6e-d6fdfbe4de52 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:38.939924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.942843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.952044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:38.952986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:38.953161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:38.953589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:38.960747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:38.961685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:38.997323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 903/1787] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:39.054061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 885/1788] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:38 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:39.064105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.093161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe9f80-9374-4e28-af59-7dc779e67624 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.198112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.200076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.200493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.200969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.202380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.205546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.207995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.210464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:39.233125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 904/1789] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:39 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:39.233125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.300294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646a0c-de2f-4836-bba7-ceb0a6a487de admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.313618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.315514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.315936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.316385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.319198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:39.323880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b56c1-afaf-4700-8573-823c92da71c0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.331329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.332123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.332509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.332956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.343790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.345927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.360360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 886/1790] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:39.361652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.372652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f402b-7c04-496f-99a8-cdc309601f75 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.378205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.378872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.379159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.379434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.380221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.382162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.393453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 887/1791] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:39.397368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.408834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.409050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677f38-efae-4ba6-9d3c-ce8bf192e98a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.410543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.414949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.415628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.415916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.416756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.417720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.419642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2e867-babc-4212-8019-081ec3623d76 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.423647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 905/1792] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:39.439286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 888/1793] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:39.444030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.461076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a512a2-e9d1-411b-a1fd-42e4d17d2357 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.471377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.475325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.475619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.475976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] PATH_INFO: `/v3/projects/cefff69977af4b8fa97b641cb3dc45f0/users/41d18740570c47b7a09d08b2cbbe2d1b/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.493277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefff69977af4b8fa97b641cb3dc45f0, user_id=41d18740570c47b7a09d08b2cbbe2d1b, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.496140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.508814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 906/1794] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:39 2022] PUT /identity/v3/projects/cefff69977af4b8fa97b641cb3dc45f0/users/41d18740570c47b7a09d08b2cbbe2d1b/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:39.520705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.521075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.521460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.549966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] MFA Rules not processed for user `41d18740570c47b7a09d08b2cbbe2d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:39.552923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:39.621147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 889/1795] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:39.625506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.693562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302eaa6-7057-43d5-971d-a1a7778fd4b1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.698817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.699667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.700014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.700363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.701267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.703891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.734380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 907/1796] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:39 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:39.740532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.752467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f51b30-c8f3-46ef-a2e7-d744c148b37a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.823387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.824063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.824343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.824614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.825328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.827850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.849299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 890/1797] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:39 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:19:39.851068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.861758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874f5-f9fe-4469-b666-b4aef8fa5e59 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.866410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.867069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.867356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.867634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.868361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.870123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.880901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 908/1798] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:39.884792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.894552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e95cfd-1c71-4cd6-b481-b09b79f35988 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.899061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.899913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.900190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.900460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] PATH_INFO: `/v3/projects/620272356e984270b7b8d16939a5153d/users/b2ad0457426c497d94ccdfa72153fee8/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.914244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=620272356e984270b7b8d16939a5153d, user_id=b2ad0457426c497d94ccdfa72153fee8, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:39.916870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:39.929950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 891/1799] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:39 2022] PUT /identity/v3/projects/620272356e984270b7b8d16939a5153d/users/b2ad0457426c497d94ccdfa72153fee8/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:19:39.933864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:39.944188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a520-8c97-4e52-8514-5864740a3ddc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:39.997324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:39.998009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:39.998824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:39.999103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:39.999824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:40.001479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951effbf-e1a7-4110-a08a-df4238a34b0d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:40.010837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 909/1800] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:40.015267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:40.025032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9af6f-5bcc-4f29-965f-b350f30b56eb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:40.029502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:40.030364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.030645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.030918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] PATH_INFO: `/v3/projects/620272356e984270b7b8d16939a5153d/users/b2ad0457426c497d94ccdfa72153fee8/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.032863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=620272356e984270b7b8d16939a5153d, user_id=b2ad0457426c497d94ccdfa72153fee8, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:40.035517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:40.045601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 892/1801] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:40 2022] PUT /identity/v3/projects/620272356e984270b7b8d16939a5153d/users/b2ad0457426c497d94ccdfa72153fee8/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:40.055292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.055585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.055867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.084278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] MFA Rules not processed for user `b2ad0457426c497d94ccdfa72153fee8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:40.085584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:40.152356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 910/1802] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:40.163867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:40.216064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed13d-5ae5-4fbe-8c92-ce7e0c12f45e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:40.220336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:40.223280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.223280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.223280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.232471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:40.234089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e434e0-a189-4fea-afa1-5f3c09b3e9d6 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:40.243844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 893/1803] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:40.617973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:40.677380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665f2b-0579-44d9-a6da-611df18f25c1 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:40.681840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:40.682705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.682989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.683263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] PATH_INFO: `/v3/users/41d18740570c47b7a09d08b2cbbe2d1b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.684443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d18740570c47b7a09d08b2cbbe2d1b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:40.687022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:40.734370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d18740570c47b7a09d08b2cbbe2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:40.741465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d18740570c47b7a09d08b2cbbe2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:40.749725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d18740570c47b7a09d08b2cbbe2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:40.750375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d18740570c47b7a09d08b2cbbe2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:40.762290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d18740570c47b7a09d08b2cbbe2d1b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:40.768346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 911/1804] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:40 2022] DELETE /identity/v3/users/41d18740570c47b7a09d08b2cbbe2d1b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:40.775098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.775423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.775706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.791990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:40.793189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:40.850690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 894/1805] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:40.860807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:40.862248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:40.919715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee81ea-c363-434c-a6e5-5b028f480278 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:40.924193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:40.924941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:40.925148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:40.925461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:40.934659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:40.936782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:40.947047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 912/1806] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:42.751294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:42.752907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:42.795267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c4713-1e70-4fdd-9a7d-f0baea61aee3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:42.814275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:42.815253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:42.815609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:42.815956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] PATH_INFO: `/v3/projects/cefff69977af4b8fa97b641cb3dc45f0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:42.817468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefff69977af4b8fa97b641cb3dc45f0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:42.821855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:42.915479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefff69977af4b8fa97b641cb3dc45f0', 'request_id': 'req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:42.942906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefff69977af4b8fa97b641cb3dc45f0', 'request_id': 'req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:42.954112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefff69977af4b8fa97b641cb3dc45f0', 'request_id': 'req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:42.975627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] The token cache is being invalidate because project cefff69977af4b8fa97b641cb3dc45f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:42.977329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:42.979365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:42.981640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 895/1807] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:42 2022] DELETE /identity/v3/projects/cefff69977af4b8fa97b641cb3dc45f0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:42.986130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:42.999402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968d09-345c-43de-88d2-8e4a5fe08488 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:43.065430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:43.066751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:43.067204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:43.067634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] PATH_INFO: `/v3/users/b2ad0457426c497d94ccdfa72153fee8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:43.069869 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ad0457426c497d94ccdfa72153fee8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:43.072126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:43.191980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ad0457426c497d94ccdfa72153fee8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.203882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ad0457426c497d94ccdfa72153fee8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.216533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ad0457426c497d94ccdfa72153fee8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.218082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ad0457426c497d94ccdfa72153fee8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.240743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-505d04e1-e093-4f1c-89d2-1d67c4b3183b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ad0457426c497d94ccdfa72153fee8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.257771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 913/1808] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:42 2022] DELETE /identity/v3/users/b2ad0457426c497d94ccdfa72153fee8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:43.293562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:43.296218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:43.311684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d5f6b-f2aa-432f-83d0-2ac2ea68fa5d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:43.407537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:43.409259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:43.411902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:43.412228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] PATH_INFO: `/v3/users/899d42e2b96743478b92fd7f97245e5f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:43.421874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899d42e2b96743478b92fd7f97245e5f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:43.423954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:43.531303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899d42e2b96743478b92fd7f97245e5f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.548090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899d42e2b96743478b92fd7f97245e5f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.558135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899d42e2b96743478b92fd7f97245e5f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.561492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899d42e2b96743478b92fd7f97245e5f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.561492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899d42e2b96743478b92fd7f97245e5f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:43.622191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 896/1809] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:43 2022] DELETE /identity/v3/users/899d42e2b96743478b92fd7f97245e5f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:43.625761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:43.626244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:43.626673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:43.702699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:43.704113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:43.777367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:43.780106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:43.823076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 914/1810] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:43.844806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:43.847728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:43.910591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59807c0-846a-4a5c-9ffe-e7d1ec49c922 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:43.916847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:43.919649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:43.920159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:43.920579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] PATH_INFO: `/v3/projects/620272356e984270b7b8d16939a5153d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:43.922060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620272356e984270b7b8d16939a5153d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:43.926007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:43.961309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c4c62-5078-4168-b42b-2c7132b2ca68 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:43.966599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:43.970626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:43.971123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:43.972903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.003959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.005619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2901404-10bc-4372-a6ac-09b770e3a206 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.018313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 915/1811] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:44.019913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620272356e984270b7b8d16939a5153d', 'request_id': 'req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:44.032020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620272356e984270b7b8d16939a5153d', 'request_id': 'req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:44.048628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620272356e984270b7b8d16939a5153d', 'request_id': 'req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:44.073733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] The token cache is being invalidate because project 620272356e984270b7b8d16939a5153d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:44.074029 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:44.080833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c1c30a24-ba2f-4e16-85bb-56a0ef1dcdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:44.082567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 897/1812] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:43 2022] DELETE /identity/v3/projects/620272356e984270b7b8d16939a5153d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:44.089776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976232-f85b-4214-838d-90e48024b201 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.090475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976232-f85b-4214-838d-90e48024b201 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.090927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976232-f85b-4214-838d-90e48024b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.110727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16c59-a70e-4031-b17e-70c2987318a1 None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.111252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16c59-a70e-4031-b17e-70c2987318a1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.111702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c16c59-a70e-4031-b17e-70c2987318a1 None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.113253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 898/1813] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:19:44.124363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.124905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.125187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.128537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-54976232-f85b-4214-838d-90e48024b201 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:44.130067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-54976232-f85b-4214-838d-90e48024b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:44.160276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:44.161548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:44.267004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 916/1814] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:44.275408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.276113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.276889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.294470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 899/1815] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:44.312203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:44.313988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:44.330678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 917/1816] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:44.331577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.360920 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4fa3-50c0-49be-8119-bc9156ba3286 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.367665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.368813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.369351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.369811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.370976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:44.371530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.374692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.393164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 900/1817] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:44.397256 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.410620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14795cc-9070-435f-8f41-b442b8b7e89c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.416944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.417718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.418070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.418433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.419208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.422581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.472432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.486622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 918/1818] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:44.489325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38f755-9531-4b68-8ed5-7e93255fb407 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.579743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.579743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.581464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.581464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.581464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.583875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.627757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.629514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:44.634688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 901/1819] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:44.639388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.661236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc1d9f-f82c-4c74-82ce-7aa6f59ea843 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.674699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.675384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.675887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.676011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.676709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.678296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.700117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 902/1820] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:44.705888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.727148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4447-1924-47a8-9444-60d570bb587f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.739888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.740678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.740846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.741118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.742013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.743763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.767652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 903/1821] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:44.771452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.786964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098ac2-fab6-4b1d-8109-1fcb51fc850f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.787911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de98c1-618c-433d-91da-d2a8862f1613 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:44.795918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.796817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.797100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.797397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] PATH_INFO: `/v3/projects/4cea52fab8de47a0be17235216ace25d/users/9e47859b07634b9684f8db77e09ff24d/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.799749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:44.800412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.800693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.800966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.818863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.821645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b55359-59b6-47d5-ad30-6fa3ae06d132 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.822801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cea52fab8de47a0be17235216ace25d, user_id=9e47859b07634b9684f8db77e09ff24d, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:44.827184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:44.851958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 919/1822] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:44.854312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 904/1823] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:44 2022] PUT /identity/v3/projects/4cea52fab8de47a0be17235216ace25d/users/9e47859b07634b9684f8db77e09ff24d/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:44.866749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:44.867517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:44.867809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:44.868085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:44.868896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:44.938192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] MFA Rules not processed for user `9e47859b07634b9684f8db77e09ff24d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:44.939433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.002746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a3380-9492-4c95-b02e-267477a9b324 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.009631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.011234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.011711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.011995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] PATH_INFO: `/v3/users/50fed350b740410aa85140b463d6abec` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.014607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fed350b740410aa85140b463d6abec)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.017222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.043985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 920/1824] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:45.048276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.061290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f37280-6090-4e60-93d5-21fdc3b579ef None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.074494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.075362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.077432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.078068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.081221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.083802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.111790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fed350b740410aa85140b463d6abec'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.122611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fed350b740410aa85140b463d6abec'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.132846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fed350b740410aa85140b463d6abec'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.133825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fed350b740410aa85140b463d6abec'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.134505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-46fdb833-44c8-436e-bdc8-2a413608d521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fed350b740410aa85140b463d6abec'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.140427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 921/1825] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:45.146211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.148081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.165118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 905/1826] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:44 2022] DELETE /identity/v3/users/50fed350b740410aa85140b463d6abec => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:45.170784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.171161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.171501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.191029 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:45.192401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.228010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e668c-c905-4f5d-91a0-c09eeb0d8323 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.321088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.323069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.323748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.324780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.325596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.327680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.328399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 906/1827] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:45.354533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 922/1828] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:45.356574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.369055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7e524-110e-4e79-8477-45af0b761193 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.374617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.376974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.382815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.385043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.385686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.386696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.390095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.393424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.415386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 907/1829] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:45.419151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.430384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9e66-29c9-4e30-bb87-32ca60946c3d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.435225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.436448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.436899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.437182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.437940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.439663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.449933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480447c-e583-4a4f-b6c3-e6e43658bf55 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.454107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 908/1830] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:45.455861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.463758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.464440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.464717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.464996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.471917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3fc4-9403-4c30-b96f-ceeec5cd2cee admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.476941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.477868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.478151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.478425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] PATH_INFO: `/v3/projects/5f3cf57be8ce4fb38a82f81ebd18269d/users/b948d42cb4694f72bc7420b8c7a769ad/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.484220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.487327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5939c-e54b-4ce5-815d-dd361b1e55e9 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.495540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3cf57be8ce4fb38a82f81ebd18269d, user_id=b948d42cb4694f72bc7420b8c7a769ad, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.498706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.504625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 923/1831] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:45.514934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 909/1832] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:45 2022] PUT /identity/v3/projects/5f3cf57be8ce4fb38a82f81ebd18269d/users/b948d42cb4694f72bc7420b8c7a769ad/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:45.524637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.525152 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.525510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.525769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.526416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.561487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] MFA Rules not processed for user `b948d42cb4694f72bc7420b8c7a769ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:45.562913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.633335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56473-c803-401e-b2ea-94808a4f0b20 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.639644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.640856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.641136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.641569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] PATH_INFO: `/v3/users/aff1714d30374afe8d669f9f3c4f0c81` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.642862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff1714d30374afe8d669f9f3c4f0c81)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.644850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.649928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 924/1833] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:45.651151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.653115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.673927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018df90-d954-4704-9adc-d4ddaa167002 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.691164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.692119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.695699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.696056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] PATH_INFO: `/v3/projects/9f29c47a6792425db5a68f971af8ad4e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.699824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f29c47a6792425db5a68f971af8ad4e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.708274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.709563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff1714d30374afe8d669f9f3c4f0c81'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.725114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff1714d30374afe8d669f9f3c4f0c81'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.744931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff1714d30374afe8d669f9f3c4f0c81'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.747017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff1714d30374afe8d669f9f3c4f0c81'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.749913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff1714d30374afe8d669f9f3c4f0c81'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.781031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 910/1834] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:45 2022] DELETE /identity/v3/users/aff1714d30374afe8d669f9f3c4f0c81 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:45.782331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.784347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.802485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f29c47a6792425db5a68f971af8ad4e', 'request_id': 'req-2763c0e4-4f9c-4002-a861-55b17d46d96c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.812005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f29c47a6792425db5a68f971af8ad4e', 'request_id': 'req-2763c0e4-4f9c-4002-a861-55b17d46d96c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.837474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f29c47a6792425db5a68f971af8ad4e', 'request_id': 'req-2763c0e4-4f9c-4002-a861-55b17d46d96c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.864514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] The token cache is being invalidate because project 9f29c47a6792425db5a68f971af8ad4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:45.865244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.866444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2763c0e4-4f9c-4002-a861-55b17d46d96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:45.871274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 925/1835] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:45 2022] DELETE /identity/v3/projects/9f29c47a6792425db5a68f971af8ad4e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:45.872964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.875263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.877690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.883395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd79556-dfbd-4aba-b60b-b4950fc302c4 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:45.889926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:45.890858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:45.891316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:45.891766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:45.892629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:45.894848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:45.915528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:45.916877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.933014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 926/1836] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:45.933014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.938267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 911/1837] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:45.939456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:45.941481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.953233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:45.968028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0a8c-c044-409b-a5da-a624959150e7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.081548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.082746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.083125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.083580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] PATH_INFO: `/v3/users/65c480b9064b4d9387281a318e9da542` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.084997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c480b9064b4d9387281a318e9da542)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.088537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.127928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ae70-6646-42f2-8360-74d734d294c1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.145719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.147031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.147031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.147031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.147685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.149929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.167657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c480b9064b4d9387281a318e9da542'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:46.179729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c480b9064b4d9387281a318e9da542'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:46.186843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 912/1838] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:45 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:46.187800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.192084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:46.194281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c480b9064b4d9387281a318e9da542'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:46.196773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c480b9064b4d9387281a318e9da542'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:46.239181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c480b9064b4d9387281a318e9da542'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:46.251848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 927/1839] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:45 2022] DELETE /identity/v3/users/65c480b9064b4d9387281a318e9da542 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:46.252912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.254917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:46.301859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b445d8-edb8-4aa1-9ccd-fe5e1a23c502 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.374275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771528e-a545-4cd5-b1f9-80c6a56c96b2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.375949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.376679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.377004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.377256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.379088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:46.380664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.381587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.381983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.382355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.383223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.385193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.402305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.403943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.421577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 913/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:46.430573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 928/1841] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:46.431942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.441509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab4d06-0cf7-4f4f-b95f-dcadd2c6b22c service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.447036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.447487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.447856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.448271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] PATH_INFO: `/v3/projects/4137547f225742959893d408c3f31247/users/f7bd9d50f95b4537b864d0b3c572d1d7/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.475646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4137547f225742959893d408c3f31247, user_id=f7bd9d50f95b4537b864d0b3c572d1d7, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.478597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.496500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 914/1842] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:46 2022] PUT /identity/v3/projects/4137547f225742959893d408c3f31247/users/f7bd9d50f95b4537b864d0b3c572d1d7/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:46.501389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.520133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127d744-307f-4830-8bbd-a3b09625c8ea admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.632458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.633588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.633973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.634443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.635531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.637568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c062c-a57f-4288-8feb-a88a80a5a163 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.650769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 929/1843] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:46.658003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.679754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61624f95-179e-49bf-bfe2-7b6a339bd7de admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:46.707728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:46.710779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.711071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.711357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] PATH_INFO: `/v3/projects/4137547f225742959893d408c3f31247/users/f7bd9d50f95b4537b864d0b3c572d1d7/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.714348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4137547f225742959893d408c3f31247, user_id=f7bd9d50f95b4537b864d0b3c572d1d7, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:46.718105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:46.737256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 915/1844] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:46 2022] PUT /identity/v3/projects/4137547f225742959893d408c3f31247/users/f7bd9d50f95b4537b864d0b3c572d1d7/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:46.748112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:46.748112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:46.748277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:46.798891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] MFA Rules not processed for user `f7bd9d50f95b4537b864d0b3c572d1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:46.802823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:46.809238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:46.811004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.027908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006209f-4965-4bf2-be4e-00ec3a6c72f7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.033067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 930/1845] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:47.034176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:47.038389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.044020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.045166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.045494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.045775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] PATH_INFO: `/v3/projects/87b097c3c0804d97aaba83ae2d3aea6b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.047317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b097c3c0804d97aaba83ae2d3aea6b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.049399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.079792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c829e8-5af4-4005-8e64-9411a28da8f4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.090515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.099637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.100515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.101477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] PATH_INFO: `/v3/projects/8f3dbe773b374e928351f345b8cd02c5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.104561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3dbe773b374e928351f345b8cd02c5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.110679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.139145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b097c3c0804d97aaba83ae2d3aea6b', 'request_id': 'req-2dbbe856-5420-439b-9e9b-bbbb074fde34'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.146269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b097c3c0804d97aaba83ae2d3aea6b', 'request_id': 'req-2dbbe856-5420-439b-9e9b-bbbb074fde34'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.157315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b097c3c0804d97aaba83ae2d3aea6b', 'request_id': 'req-2dbbe856-5420-439b-9e9b-bbbb074fde34'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.175252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] The token cache is being invalidate because project 87b097c3c0804d97aaba83ae2d3aea6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:47.175698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.176441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.181876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 916/1846] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:46 2022] DELETE /identity/v3/projects/87b097c3c0804d97aaba83ae2d3aea6b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:47.183317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:47.183424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3dbe773b374e928351f345b8cd02c5', 'request_id': 'req-1c2244a5-1603-4e85-86ed-d46c751baee1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.185169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.191515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3dbe773b374e928351f345b8cd02c5', 'request_id': 'req-1c2244a5-1603-4e85-86ed-d46c751baee1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.199273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3dbe773b374e928351f345b8cd02c5', 'request_id': 'req-1c2244a5-1603-4e85-86ed-d46c751baee1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.214930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] The token cache is being invalidate because project 8f3dbe773b374e928351f345b8cd02c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:47.215315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.216191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.219197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 931/1847] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:47 2022] DELETE /identity/v3/projects/8f3dbe773b374e928351f345b8cd02c5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:47.219913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:47.221632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.270776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbe856-5420-439b-9e9b-bbbb074fde34 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.313474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2244a5-1603-4e85-86ed-d46c751baee1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.319628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.320754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.321161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.321540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] PATH_INFO: `/v3/users/2bf2f6e91aa444aaaa11e0ee547313ff` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.323159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf2f6e91aa444aaaa11e0ee547313ff)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.325412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.336630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.337548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.337833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.338166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.340304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.382842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf2f6e91aa444aaaa11e0ee547313ff'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.391417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf2f6e91aa444aaaa11e0ee547313ff'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.402945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf2f6e91aa444aaaa11e0ee547313ff'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.403900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf2f6e91aa444aaaa11e0ee547313ff'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.419946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf2f6e91aa444aaaa11e0ee547313ff'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.425020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.426648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.430998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 932/1848] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:47 2022] DELETE /identity/v3/users/2bf2f6e91aa444aaaa11e0ee547313ff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:47.431851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:47.433241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.454430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 917/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:47.526603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd0442-8f0d-4b23-bc71-6d0ff2c35350 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.536777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.537860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.538276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.538416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] PATH_INFO: `/v3/users/587b3acbc67746b5803435a2572f55de` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.539808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=587b3acbc67746b5803435a2572f55de)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.541717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.572439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:47.574604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.595309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbae46-7fec-418c-85ea-667d6a69a487 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:47.602697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:47.604264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.606164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.606164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] PATH_INFO: `/v3/projects/b08b2b66838541d9a1494dfc1b751bac` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.607527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08b2b66838541d9a1494dfc1b751bac)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:47.610171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:47.641159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587b3acbc67746b5803435a2572f55de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.660141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587b3acbc67746b5803435a2572f55de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.693862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587b3acbc67746b5803435a2572f55de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.695860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587b3acbc67746b5803435a2572f55de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.714466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08b2b66838541d9a1494dfc1b751bac', 'request_id': 'req-61382263-18eb-4ab2-8a47-6507eafe5242'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.721581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-119b5de9-74b9-4b44-9425-ba22acbca34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587b3acbc67746b5803435a2572f55de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.730940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08b2b66838541d9a1494dfc1b751bac', 'request_id': 'req-61382263-18eb-4ab2-8a47-6507eafe5242'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.738930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 933/1850] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:47 2022] DELETE /identity/v3/users/587b3acbc67746b5803435a2572f55de => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:47.755568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08b2b66838541d9a1494dfc1b751bac', 'request_id': 'req-61382263-18eb-4ab2-8a47-6507eafe5242'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.778636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] The token cache is being invalidate because project b08b2b66838541d9a1494dfc1b751bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:47.779437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.781658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-61382263-18eb-4ab2-8a47-6507eafe5242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:47.786720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 918/1851] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:47 2022] DELETE /identity/v3/projects/b08b2b66838541d9a1494dfc1b751bac => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:47.791514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586225cf-5407-46a0-b985-7c341e761462 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.791809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586225cf-5407-46a0-b985-7c341e761462 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.792091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586225cf-5407-46a0-b985-7c341e761462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:47.830600 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-586225cf-5407-46a0-b985-7c341e761462 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:47.831802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-586225cf-5407-46a0-b985-7c341e761462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:47.965258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 934/1852] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:47.973547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:47.973839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:47.974119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.022466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:48.023992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.045576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 919/1853] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:48.049593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586225cf-5407-46a0-b985-7c341e761462 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.069531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586225cf-5407-46a0-b985-7c341e761462 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.075332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.077601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.078200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.079515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.081663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:48.083561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.105988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.114149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.116162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.127524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 935/1854] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:19:48.132969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.144845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011d1d-ffad-4a73-905a-1166e73a3348 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.150551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722c1bc-517c-41ad-913f-c98a7ead726f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.151265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.152155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.152475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.152940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] PATH_INFO: `/v3/projects/0b4d83b82670417687ec564e9823ba1c` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.154468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4d83b82670417687ec564e9823ba1c)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.156402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.164523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.165361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.165645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.166197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.167043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.169124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.221572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 936/1855] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/projects => generated 409 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:48.225971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.226805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4d83b82670417687ec564e9823ba1c', 'request_id': 'req-da6c7f4d-a055-4e15-868d-b8b85816b294'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.236472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4d83b82670417687ec564e9823ba1c', 'request_id': 'req-da6c7f4d-a055-4e15-868d-b8b85816b294'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.256690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4d83b82670417687ec564e9823ba1c', 'request_id': 'req-da6c7f4d-a055-4e15-868d-b8b85816b294'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.292853 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] The token cache is being invalidate because project 0b4d83b82670417687ec564e9823ba1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:48.293159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.302201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.304833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 920/1856] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:48 2022] DELETE /identity/v3/projects/0b4d83b82670417687ec564e9823ba1c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:19:48.305644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.310099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.396176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934939-cced-43bf-8d3b-50441553c683 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.406891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.407580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.409676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.409991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.410708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.416371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058187c4-1a22-49da-846e-c811f13d4e8a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.428408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7f4d-a055-4e15-868d-b8b85816b294 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.437710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.438880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.439812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.440400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] PATH_INFO: `/v3/projects/44df3f998c5a44018116ec9e6f256397` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.444829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44df3f998c5a44018116ec9e6f256397)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.462732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.464018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 937/1857] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/users => generated 305 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:48.465820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.466119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.466407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.487331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:48.488727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.505016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 938/1858] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:48.506353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.507803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.567731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44df3f998c5a44018116ec9e6f256397', 'request_id': 'req-5da650fb-8b53-489c-ab05-36231f771710'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.575660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44df3f998c5a44018116ec9e6f256397', 'request_id': 'req-5da650fb-8b53-489c-ab05-36231f771710'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.589285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44df3f998c5a44018116ec9e6f256397', 'request_id': 'req-5da650fb-8b53-489c-ab05-36231f771710'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.592705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8c10-c485-4798-b539-c014bce14612 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.614729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] The token cache is being invalidate because project 44df3f998c5a44018116ec9e6f256397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:48.615070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.617890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:48.620064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 921/1859] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:48 2022] DELETE /identity/v3/projects/44df3f998c5a44018116ec9e6f256397 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:48.621648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.625306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.715227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.715893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.716179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.716456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.719175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.774075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da650fb-8b53-489c-ab05-36231f771710 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.780771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.781762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.782416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.783362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.784953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.787722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e4260-0fb7-48ae-934c-54a7fb578fa8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.808982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 922/1860] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:48.811623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.812458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.812948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.821547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.823047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3f66a-5873-45ec-96d1-a0a5f9c8b59d service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.849271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 939/1861] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:48.852712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.855258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.855947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.865290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:48.867139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.896762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:48.898151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 923/1862] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:48.899398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.901531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:48.921192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 940/1863] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:48.922081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:48.946331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c172135-ac62-4ba8-9b66-0b1d6b17a0a7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.949455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b01c84-2c6f-47ab-8c3e-18b3a0819e95 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:48.957441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.958416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.958709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.958989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.959729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:48.960034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.961680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a60159-9385-4c25-b198-d53b5757313c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.965770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:48.969919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.970493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.971530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:48.972901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:48.976444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:48.992085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 941/1864] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:48.995182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:48.995543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:48.996498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.002707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 924/1865] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.003754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.016073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4c70-a818-4fd5-b9ec-c3d1d4a9aba5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.031233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.032991 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:49.033587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.033887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.034178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.034327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:49.034896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.038635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.043525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 942/1866] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:49.044217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.053817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aaae2-9f23-4ed8-abac-c2bd4cf8f5c2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.058635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.059515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.059802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.060076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] PATH_INFO: `/v3/projects/f5c8917208ed45bfbc9da6770b2db049/users/c4cd88442da04ae091916a2238b8a705/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.083346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c8917208ed45bfbc9da6770b2db049, user_id=c4cd88442da04ae091916a2238b8a705, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.085365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 925/1867] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.086477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.090635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.118639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 943/1868] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:49 2022] PUT /identity/v3/projects/f5c8917208ed45bfbc9da6770b2db049/users/c4cd88442da04ae091916a2238b8a705/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:49.121198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.231359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff630cbc-195e-4e59-8842-cf5a3088272a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.242146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.242847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.243253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.243433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.244333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.246773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.257083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca1c82-74fb-49a5-b26b-ee95939531f5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.276739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.277451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.277737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.278008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.289331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:49.289668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.291484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f53c25-f65f-4c65-aff3-56938445a763 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.339361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 926/1869] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:49.344757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.344936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.345237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.367905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 944/1870] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.372235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.409005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eb680-cb10-4645-aa4e-6a57419a4fa3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.429976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] MFA Rules not processed for user `c4cd88442da04ae091916a2238b8a705`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:49.432741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.433465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.433764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.434038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.434741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.436734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.439826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:49.475017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 945/1871] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.476587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.537366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 927/1872] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:49.538589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.556032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c889d38-4a67-474f-b2f5-b09b8038e753 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.573082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a39a3-225a-4014-8614-19d469518d6f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.579737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.580432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.580725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.581338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.582295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.583935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.605409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 946/1873] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.606815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.621884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15aef5-505a-457c-b375-d5a7acacf055 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.628475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.629151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.629633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.629918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.631418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.633777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.641186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.642432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.643777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.645127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.645693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.648127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.670825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 947/1874] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.672037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.675536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 928/1875] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.675536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.686399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923edcaa-e82c-4d46-a0d6-86843bd730ed admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.734493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bf397-d722-415b-b499-bb1089d096c7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.739225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.739912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.740199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.740478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.741224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.742849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.743925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.744649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.744959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.745245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.745932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.747898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.752772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 948/1876] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.754788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.766844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395280ae-7c02-4715-84ba-0b25742a4e89 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.771339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 929/1877] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:49.771516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.771999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.772126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.772407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.772684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.773440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.775071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.784068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5d7d1-8c09-43f7-bb0b-cf74bd809f0d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.785592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 949/1878] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.786247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.791742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.792622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.792907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.793187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] PATH_INFO: `/v3/projects/d97e7a20bec440258d7efc3fac4dff54/users/7a4cd1576ee74fe49c930ac93adc18aa/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.795671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac078-167a-4fe5-bcf1-5f19b1a3e71c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.802037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.802037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.802037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.802037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.802560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.804614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.809541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e7a20bec440258d7efc3fac4dff54, user_id=7a4cd1576ee74fe49c930ac93adc18aa, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.812297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.814484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 950/1879] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.820189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.827676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 930/1880] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:49 2022] PUT /identity/v3/projects/d97e7a20bec440258d7efc3fac4dff54/users/7a4cd1576ee74fe49c930ac93adc18aa/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:49.828465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.840665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82a0ed-c914-40d0-9cf8-f1cae83f9204 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.887509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4623fd-2e52-42f1-88ff-4a80ffabae1b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.892668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.893576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.893854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.894126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] PATH_INFO: `/v3/projects/b619c299bd59424c87a3da42a2053008/users/f3af49af42ff4b92af34c72fd58d80e9/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.895569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.896236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.896521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.896798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.897551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.899153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2fa4c-ccd0-4633-a70b-267821e339d5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.909595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b619c299bd59424c87a3da42a2053008, user_id=f3af49af42ff4b92af34c72fd58d80e9, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:49.909757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 951/1881] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:49.910998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.911287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.911554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:49.912329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:49.925994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 931/1882] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:49 2022] PUT /identity/v3/projects/b619c299bd59424c87a3da42a2053008/users/f3af49af42ff4b92af34c72fd58d80e9/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:49.926689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:49.938504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] MFA Rules not processed for user `7a4cd1576ee74fe49c930ac93adc18aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:49.939844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:49.989759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff719f-153f-4ad8-a384-1fdd89dfadcb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:49.995348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:49.996336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:49.996625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:49.997003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] PATH_INFO: `/v3/projects/9f50eb0c70cf42a29ab57320ae8e43b3/users/5bac958dddc8496e948b34d805ce7057/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.012231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f50eb0c70cf42a29ab57320ae8e43b3, user_id=5bac958dddc8496e948b34d805ce7057, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.014585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 952/1883] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:50.015519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.018191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.032622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939d844-6fbf-4d2e-b995-f074aa1edc28 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.036549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 932/1884] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:49 2022] PUT /identity/v3/projects/9f50eb0c70cf42a29ab57320ae8e43b3/users/5bac958dddc8496e948b34d805ce7057/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:50.037602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.048829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:50.116487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.117595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.118032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.118455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.119381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.123848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f19e7-68a3-4d26-b895-6cf84dfd3422 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.130164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ed87a-ee26-4f9c-825e-408bd5a5e18e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.136168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 953/1885] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:50.136554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.137865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cfa2e-b894-48ce-b011-4ebd0dd2145a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.138416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.139084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cfa2e-b894-48ce-b011-4ebd0dd2145a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.139395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.139644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cfa2e-b894-48ce-b011-4ebd0dd2145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.139972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.174485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cb4cfa2e-b894-48ce-b011-4ebd0dd2145a None None] MFA Rules not processed for user `5bac958dddc8496e948b34d805ce7057`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:50.176332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cb4cfa2e-b894-48ce-b011-4ebd0dd2145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:50.216067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.218086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.228265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 933/1886] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:50.229719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.250207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5380e6-529a-4281-a8ce-5e1f6c269edc service glance] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.255962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.256856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.257167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.257494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] PATH_INFO: `/v3/projects/b619c299bd59424c87a3da42a2053008/users/f3af49af42ff4b92af34c72fd58d80e9/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.259473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b619c299bd59424c87a3da42a2053008, user_id=f3af49af42ff4b92af34c72fd58d80e9, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.262479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.273572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 934/1887] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:50 2022] PUT /identity/v3/projects/b619c299bd59424c87a3da42a2053008/users/f3af49af42ff4b92af34c72fd58d80e9/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:50.274001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 954/1888] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:50.278097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.286241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.286626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.287195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.314819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] MFA Rules not processed for user `f3af49af42ff4b92af34c72fd58d80e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:50.316038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:50.349470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd17e8-1d45-429d-bbea-6990bb6d067b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.358124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.358797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.359083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.359362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.360181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.362276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.389305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 955/1889] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:50.398498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 935/1890] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:50 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:50.402212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.402338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.403863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:50.481131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe83f-f01a-4cf8-9371-c39bdf5de67e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.529384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce625e5-9594-4431-81b0-6d49084f5ee5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.541251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.542428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.542428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.542756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.543532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.546331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.557455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.558335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.558626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.559386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.593261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 936/1891] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:50 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:19:50.596172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.610070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a6281-c56d-444d-89b7-1b9b586020c1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.615457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.616142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.616429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.616707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.617516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.619141 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.637779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 937/1892] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:19:50.639528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.661283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19dab7-0282-4431-ac4a-8f19d8c4b0c1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.667611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.669122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.669473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.670380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] PATH_INFO: `/v3/projects/1d80740e6b104e28b9b3c74e158c8084/users/1b6b412df66e4af689b3eca9c9244e60/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.696307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.698106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.698360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d80740e6b104e28b9b3c74e158c8084, user_id=1b6b412df66e4af689b3eca9c9244e60, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.701085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.710046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 956/1893] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:19:50.722034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 938/1894] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:50 2022] PUT /identity/v3/projects/1d80740e6b104e28b9b3c74e158c8084/users/1b6b412df66e4af689b3eca9c9244e60/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:19:50.725821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.741649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fc4-73b1-453e-96d4-599d1f330a39 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.815104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.815816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.816065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.816346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.817255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.819013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31cf26-7901-425a-bc30-6946f1b9fc9b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.840897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 957/1895] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:50.845649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:50.873854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63deb-7d2e-418d-824c-7eb5d487668c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:50.880695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:50.881652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.881938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.882217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] PATH_INFO: `/v3/projects/1d80740e6b104e28b9b3c74e158c8084/users/1b6b412df66e4af689b3eca9c9244e60/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.886410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d80740e6b104e28b9b3c74e158c8084, user_id=1b6b412df66e4af689b3eca9c9244e60, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:50.889698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:50.909931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 939/1896] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:50 2022] PUT /identity/v3/projects/1d80740e6b104e28b9b3c74e158c8084/users/1b6b412df66e4af689b3eca9c9244e60/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:50.922514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:50.922830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:50.923369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:50.985309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] MFA Rules not processed for user `1b6b412df66e4af689b3eca9c9244e60`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:50.987646 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:51.099936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 958/1897] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:51.114398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:51.193345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10e7b5-263f-4da5-975e-7aff8a630401 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:51.205603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:51.205603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:51.205603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:51.205603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:51.217945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:51.219634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:51.252468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d95a1b-d1ca-47c0-b1fe-421eb41725bf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:51.261744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:51.262997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:51.264064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:51.264464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:51.276299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:51.282546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:51.294417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 959/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:51.331566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:51.333541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba395-d638-402d-9c9b-c6d1a7bbcd87 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:51.347231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 940/1899] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:51.695441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:51.804043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d9e3f-ee10-448c-ae4c-df60693063c4 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:51.812013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:51.813345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:51.813860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:51.814340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] PATH_INFO: `/v3/users/5bac958dddc8496e948b34d805ce7057` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:51.816694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bac958dddc8496e948b34d805ce7057)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:51.819313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:51.897223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bac958dddc8496e948b34d805ce7057'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:51.905793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bac958dddc8496e948b34d805ce7057'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:51.913819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bac958dddc8496e948b34d805ce7057'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:51.914487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bac958dddc8496e948b34d805ce7057'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:51.928047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bac958dddc8496e948b34d805ce7057'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:51.934226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 960/1900] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:51 2022] DELETE /identity/v3/users/5bac958dddc8496e948b34d805ce7057 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:51.939332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:51.939620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:51.939898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:51.957572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:51.958790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:52.024790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 941/1901] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:52.034530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:52.036007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:52.100439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08a80-5594-41f2-b77d-7a5c44a2a2da admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:52.111121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:52.111121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:52.111121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:52.111121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:52.128204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:52.129903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:52.142689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 961/1902] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:52.549938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:52.551409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:52.564685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709553f0-0be9-4a26-bd8b-e7397432f5a2 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:52.569875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:52.570752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:52.571037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:52.571318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] PATH_INFO: `/v3/projects/9f50eb0c70cf42a29ab57320ae8e43b3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:52.572879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f50eb0c70cf42a29ab57320ae8e43b3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:52.574528 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:52.696612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f50eb0c70cf42a29ab57320ae8e43b3', 'request_id': 'req-0d08b429-7a5b-4ce0-b96f-376f46cb0632'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.709495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f50eb0c70cf42a29ab57320ae8e43b3', 'request_id': 'req-0d08b429-7a5b-4ce0-b96f-376f46cb0632'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.720437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f50eb0c70cf42a29ab57320ae8e43b3', 'request_id': 'req-0d08b429-7a5b-4ce0-b96f-376f46cb0632'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.735176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] The token cache is being invalidate because project 9f50eb0c70cf42a29ab57320ae8e43b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:52.735470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.736171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.738286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 942/1903] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:52 2022] DELETE /identity/v3/projects/9f50eb0c70cf42a29ab57320ae8e43b3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:52.742719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:52.753845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512f962-3bae-4b01-b36a-115d1dd3d00a service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:52.839441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:52.847480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:52.847897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:52.848597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] PATH_INFO: `/v3/users/1b6b412df66e4af689b3eca9c9244e60` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:52.850174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6b412df66e4af689b3eca9c9244e60)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:52.852913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:52.939047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6b412df66e4af689b3eca9c9244e60'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.947404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6b412df66e4af689b3eca9c9244e60'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.958310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6b412df66e4af689b3eca9c9244e60'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.958958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6b412df66e4af689b3eca9c9244e60'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:52.989815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b86405cc-0b56-4b1f-b47d-7c61f6a65a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6b412df66e4af689b3eca9c9244e60'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.000116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 962/1904] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:19:52 2022] DELETE /identity/v3/users/1b6b412df66e4af689b3eca9c9244e60 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:53.376743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.381526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:53.395091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b429-7a5b-4ce0-b96f-376f46cb0632 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.457186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.458181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.458457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.458723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] PATH_INFO: `/v3/projects/1d80740e6b104e28b9b3c74e158c8084` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.459909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d80740e6b104e28b9b3c74e158c8084)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.462067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.513226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d80740e6b104e28b9b3c74e158c8084', 'request_id': 'req-a38390fb-4260-4416-befa-27db38ac4a80'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.518269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d80740e6b104e28b9b3c74e158c8084', 'request_id': 'req-a38390fb-4260-4416-befa-27db38ac4a80'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.526028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d80740e6b104e28b9b3c74e158c8084', 'request_id': 'req-a38390fb-4260-4416-befa-27db38ac4a80'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.537520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] The token cache is being invalidate because project 1d80740e6b104e28b9b3c74e158c8084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:19:53.537804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.538455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a38390fb-4260-4416-befa-27db38ac4a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:19:53.539990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 943/1905] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:19:53 2022] DELETE /identity/v3/projects/1d80740e6b104e28b9b3c74e158c8084 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:53.545321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.545611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.545886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.565109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:53.566360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:53.624665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 963/1906] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:53.637872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.638368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.638490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.666545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:53.667877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:53.676522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 944/1907] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:53.680722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.691123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eedb7-bb58-4f7f-aaad-63ea71c356a6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.696318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.697001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.697405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.697689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.698605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:19:53.698793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.700530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.712572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 964/1908] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:19:53.717560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.726982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8e62-d502-4e18-8f4a-0fe170766339 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.733099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.733805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.734122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.734408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.735096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.737040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.763866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 945/1909] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:53 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:53.768067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.778028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb2e86-5a98-47bb-a75f-72ebf1429194 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.840944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.841747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.842034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.842315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.843024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.844942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.867819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 965/1910] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:53 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:19:53.871864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.882750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f6ba-6888-48fe-8887-93ca7461c0fd admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.888300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.889594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.889880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.890153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.890876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.892478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.903327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 946/1911] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:53.907358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.920813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f365c3-2d73-4a77-a804-36262c7634b3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.922295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.922961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.923270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.923543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.924265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.925918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6acf1f-1bf7-42a0-b32f-7e3723985702 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.936512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 966/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:53.940646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:53.951551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597120f-fb8c-40bd-86a0-cf2161ab6f22 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:53.956903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:53.957836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:53.958115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:53.958387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] PATH_INFO: `/v3/projects/6aca076d586e4fa7b0f2ca43e1189912/users/8fd566b3569b42ffa6554e1f6991b6c4/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:53.973175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aca076d586e4fa7b0f2ca43e1189912, user_id=8fd566b3569b42ffa6554e1f6991b6c4, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:53.976119 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:53.991294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 947/1913] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:53 2022] PUT /identity/v3/projects/6aca076d586e4fa7b0f2ca43e1189912/users/8fd566b3569b42ffa6554e1f6991b6c4/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:54.003549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.003836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.004141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.031401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] MFA Rules not processed for user `8fd566b3569b42ffa6554e1f6991b6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:54.032547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:54.098032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 967/1914] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:19:54.102549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.187674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894974e8-f37a-4a18-b355-89df32d1839a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.192450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.193125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.193437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.193716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.194412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.196360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.225257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 948/1915] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:19:54 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:19:54.227437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.239555 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185703f-30de-4173-8810-6ed124dc4dc9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.296876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.297508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.297788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.298059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.298749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.300671 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.323461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 968/1916] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:19:54 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:19:54.325432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.335739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68bf39-2f25-49fd-927f-e0e99948aaed admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.340365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.341005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.341323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.341595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.342312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.343909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.355489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 949/1917] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:54.359979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.370191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c690c3-c79b-486a-8b04-59f101f76ac1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.376016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.376914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.377198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.377501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] PATH_INFO: `/v3/projects/44592e5ef9884f0fb067262d95bdd8b6/users/83e0a4120ba24556b1598d38461a8721/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.393517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44592e5ef9884f0fb067262d95bdd8b6, user_id=83e0a4120ba24556b1598d38461a8721, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.396185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.409348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 969/1918] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:54 2022] PUT /identity/v3/projects/44592e5ef9884f0fb067262d95bdd8b6/users/83e0a4120ba24556b1598d38461a8721/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:54.413171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.423489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906eb5d-9661-41a4-91f9-68d1e0252a40 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.478802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.479483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.479765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.480043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.480801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.483023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d680b-9a0e-4e61-a930-8cba47173101 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.492710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 950/1919] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:19:54.497130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.507688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f18ca-69da-4966-86d2-091ced35a6f3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.512716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.513662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.513973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.514250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] PATH_INFO: `/v3/projects/44592e5ef9884f0fb067262d95bdd8b6/users/83e0a4120ba24556b1598d38461a8721/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.516254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=44592e5ef9884f0fb067262d95bdd8b6, user_id=83e0a4120ba24556b1598d38461a8721, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.518935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.530024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 970/1920] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:19:54 2022] PUT /identity/v3/projects/44592e5ef9884f0fb067262d95bdd8b6/users/83e0a4120ba24556b1598d38461a8721/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:19:54.539966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.540253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.540530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.569737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] MFA Rules not processed for user `83e0a4120ba24556b1598d38461a8721`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:19:54.570869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:54.643158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 951/1921] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:19:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:19:54.655272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.657237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:54.715908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b6679-34cc-4eb3-8062-85c6249119ac admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.720614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.721371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.721662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.722009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.731485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.733522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.742706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 971/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:54.824321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:54.834479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ff247-256d-4ee7-a1d0-7710d15b0d2e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:54.838138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:54.838794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:54.839071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:54.839343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:54.895174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:54.896952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:54.907512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 952/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:19:57.673988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:19:57.675582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:57.693270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5606-77b8-4863-aab9-5fd69c2853d7 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:19:57.698145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:19:57.699014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:19:57.699438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:19:57.699857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:19:57.701925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:19:57.771414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:19:57.772925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972a7d5-16ff-4950-8eb5-e8b2d28db4ba service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:19:57.783254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 972/1924] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:00.020058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:00.021653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.095524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d0f53-9dc2-464e-95c3-1fcd674ded87 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:00.100592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:00.101536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.101816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.102084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] PATH_INFO: `/v3/users/9e47859b07634b9684f8db77e09ff24d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.104204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e47859b07634b9684f8db77e09ff24d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:00.106404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:00.165279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e47859b07634b9684f8db77e09ff24d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.173816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e47859b07634b9684f8db77e09ff24d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.182182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e47859b07634b9684f8db77e09ff24d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.182848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e47859b07634b9684f8db77e09ff24d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.183473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e47859b07634b9684f8db77e09ff24d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.206882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.207898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.208667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.211540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 953/1925] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:00 2022] DELETE /identity/v3/users/9e47859b07634b9684f8db77e09ff24d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:00.227428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:00.229446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.300832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 973/1926] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:00.310974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:00.313859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.326876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:00.330295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.342934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49363add-8fe9-40ac-b4d4-af4318863e77 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:00.349430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:00.351808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.352252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.352673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] PATH_INFO: `/v3/users/c4cd88442da04ae091916a2238b8a705` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.354227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4cd88442da04ae091916a2238b8a705)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:00.356945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:00.392827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e2af-8f2b-4d05-b5e4-64b02b3c54ad admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:00.397808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:00.398667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.398977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.399254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.412409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:00.413745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7705-b80e-42b9-b557-e4f82938eceb service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:00.426684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 954/1927] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:00.432122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4cd88442da04ae091916a2238b8a705'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.439767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4cd88442da04ae091916a2238b8a705'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.452282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4cd88442da04ae091916a2238b8a705'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.453779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4cd88442da04ae091916a2238b8a705'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.468286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4cd88442da04ae091916a2238b8a705'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:00.475307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 974/1928] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:00 2022] DELETE /identity/v3/users/c4cd88442da04ae091916a2238b8a705 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:00.480113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.480412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.480739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.504434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:00.506219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.589928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 955/1929] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:00.615330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:00.618283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:00.726786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d292-0619-405d-a769-06cc93ff4270 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:00.731441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:00.733897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:00.734563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:00.734885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:00.761550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:00.763308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad445236-bcee-43a4-8f0f-442d11f3b781 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:00.788569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 975/1930] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:00.992551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:00.995156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:01.016896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab34c9-59e0-4057-ab54-62af48fa7c09 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:01.022572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:01.023597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:01.024365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:01.024365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] PATH_INFO: `/v3/users/8fd566b3569b42ffa6554e1f6991b6c4` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:01.025661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd566b3569b42ffa6554e1f6991b6c4)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:01.027717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:01.099967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd566b3569b42ffa6554e1f6991b6c4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:01.111720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd566b3569b42ffa6554e1f6991b6c4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:01.120617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd566b3569b42ffa6554e1f6991b6c4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:01.121680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd566b3569b42ffa6554e1f6991b6c4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:01.123345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd566b3569b42ffa6554e1f6991b6c4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:01.148851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 956/1931] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:00 2022] DELETE /identity/v3/users/8fd566b3569b42ffa6554e1f6991b6c4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:01.153198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:01.153525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:01.153843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:01.174166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:01.175655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:01.242941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 976/1932] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:01.257708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:01.259740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:01.335794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957dc43-9fd0-42fb-ae0b-869ea4feed9d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:01.339763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:01.340512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:01.340881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:01.341936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:01.352084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:01.353699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:01.371535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 957/1933] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:01.926136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:01.927941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:01.948041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75686e80-b2a6-4961-bd59-9c0dfc86d27b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:01.964888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:01.966788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:01.967546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:01.968021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] PATH_INFO: `/v3/projects/6aca076d586e4fa7b0f2ca43e1189912` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:01.969737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aca076d586e4fa7b0f2ca43e1189912)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:01.972208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:02.009044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:02.010814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:02.051187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aca076d586e4fa7b0f2ca43e1189912', 'request_id': 'req-87a58005-4d59-4529-8574-1abfc64a3c17'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.052586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e27f1-5699-4d0f-a683-60c468d9dcef service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:02.058687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aca076d586e4fa7b0f2ca43e1189912', 'request_id': 'req-87a58005-4d59-4529-8574-1abfc64a3c17'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.065135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aca076d586e4fa7b0f2ca43e1189912', 'request_id': 'req-87a58005-4d59-4529-8574-1abfc64a3c17'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.088821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] The token cache is being invalidate because project 6aca076d586e4fa7b0f2ca43e1189912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:02.089039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.101693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.106183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 977/1934] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:01 2022] DELETE /identity/v3/projects/6aca076d586e4fa7b0f2ca43e1189912 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:02.107880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:02.110019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:02.180541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:02.181929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:02.183779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:02.184391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] PATH_INFO: `/v3/projects/4cea52fab8de47a0be17235216ace25d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:02.187172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cea52fab8de47a0be17235216ace25d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:02.191295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:02.238853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a58005-4d59-4529-8574-1abfc64a3c17 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:02.244243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:02.245787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:02.246244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:02.246667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] PATH_INFO: `/v3/users/83e0a4120ba24556b1598d38461a8721` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:02.248424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e0a4120ba24556b1598d38461a8721)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:02.250599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:02.287113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cea52fab8de47a0be17235216ace25d', 'request_id': 'req-f0650061-0b62-4f8e-9518-8a00c7bae648'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.306319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cea52fab8de47a0be17235216ace25d', 'request_id': 'req-f0650061-0b62-4f8e-9518-8a00c7bae648'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.318520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cea52fab8de47a0be17235216ace25d', 'request_id': 'req-f0650061-0b62-4f8e-9518-8a00c7bae648'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.338280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] The token cache is being invalidate because project 4cea52fab8de47a0be17235216ace25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:02.338280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.338280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.340190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 958/1935] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:02 2022] DELETE /identity/v3/projects/4cea52fab8de47a0be17235216ace25d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:02.344236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e0a4120ba24556b1598d38461a8721'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.344917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:02.347979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:02.351983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e0a4120ba24556b1598d38461a8721'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.363458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e0a4120ba24556b1598d38461a8721'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.364218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e0a4120ba24556b1598d38461a8721'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.379698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e0a4120ba24556b1598d38461a8721'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.389626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 978/1936] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:02 2022] DELETE /identity/v3/users/83e0a4120ba24556b1598d38461a8721 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:02.452329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650061-0b62-4f8e-9518-8a00c7bae648 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:02.515997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:02.518950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:02.573848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:02.575484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:02.577889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:02.580233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] PATH_INFO: `/v3/users/b948d42cb4694f72bc7420b8c7a769ad` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:02.583949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b948d42cb4694f72bc7420b8c7a769ad)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:02.588965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:02.636575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c8bf-db87-4a63-b804-152857f1b382 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:02.648334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:02.650305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:02.650822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:02.651260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] PATH_INFO: `/v3/projects/f5c8917208ed45bfbc9da6770b2db049` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:02.653194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c8917208ed45bfbc9da6770b2db049)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:02.655716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:02.702603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b948d42cb4694f72bc7420b8c7a769ad'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.713919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b948d42cb4694f72bc7420b8c7a769ad'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.736764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b948d42cb4694f72bc7420b8c7a769ad'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.740267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b948d42cb4694f72bc7420b8c7a769ad'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.741016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b948d42cb4694f72bc7420b8c7a769ad'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.789758 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 959/1937] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:02 2022] DELETE /identity/v3/users/b948d42cb4694f72bc7420b8c7a769ad => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:02.813088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c8917208ed45bfbc9da6770b2db049', 'request_id': 'req-5deed06d-4e31-4389-befe-0955c92911a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.824981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c8917208ed45bfbc9da6770b2db049', 'request_id': 'req-5deed06d-4e31-4389-befe-0955c92911a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.832746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c8917208ed45bfbc9da6770b2db049', 'request_id': 'req-5deed06d-4e31-4389-befe-0955c92911a1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.862148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] The token cache is being invalidate because project f5c8917208ed45bfbc9da6770b2db049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:02.862921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.863792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:02.869243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 979/1938] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:02 2022] DELETE /identity/v3/projects/f5c8917208ed45bfbc9da6770b2db049 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:02.871861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:02.875288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:03.054227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4097d5-1dfd-4ca5-aff0-a143b4a9f9e0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:03.059534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:03.060606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:03.060888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:03.061163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] PATH_INFO: `/v3/users/f3af49af42ff4b92af34c72fd58d80e9` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:03.063347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3af49af42ff4b92af34c72fd58d80e9)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:03.066501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:03.209664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3af49af42ff4b92af34c72fd58d80e9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.229716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3af49af42ff4b92af34c72fd58d80e9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.254406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3af49af42ff4b92af34c72fd58d80e9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.258175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3af49af42ff4b92af34c72fd58d80e9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.258856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3af49af42ff4b92af34c72fd58d80e9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.326597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 960/1939] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:02 2022] DELETE /identity/v3/users/f3af49af42ff4b92af34c72fd58d80e9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:03.346749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:03.348243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:03.481667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deed06d-4e31-4389-befe-0955c92911a1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:03.569045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:03.570987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:03.643884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:03.645296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:03.645745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:03.646357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] PATH_INFO: `/v3/projects/44592e5ef9884f0fb067262d95bdd8b6` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:03.649182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44592e5ef9884f0fb067262d95bdd8b6)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:03.652358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:03.726336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e251c-8a8d-425d-9ee8-de1010437eb1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:03.751378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:03.752270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:03.752596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:03.752870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] PATH_INFO: `/v3/projects/5f3cf57be8ce4fb38a82f81ebd18269d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:03.755952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3cf57be8ce4fb38a82f81ebd18269d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:03.757907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:03.775807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44592e5ef9884f0fb067262d95bdd8b6', 'request_id': 'req-4f236e97-e5dc-449a-b546-615a59dbc17e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.784659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44592e5ef9884f0fb067262d95bdd8b6', 'request_id': 'req-4f236e97-e5dc-449a-b546-615a59dbc17e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.793795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44592e5ef9884f0fb067262d95bdd8b6', 'request_id': 'req-4f236e97-e5dc-449a-b546-615a59dbc17e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.813752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] The token cache is being invalidate because project 44592e5ef9884f0fb067262d95bdd8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:03.813956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.814673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4f236e97-e5dc-449a-b546-615a59dbc17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.816342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 980/1940] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:03 2022] DELETE /identity/v3/projects/44592e5ef9884f0fb067262d95bdd8b6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:03.822334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81609a-26ad-4a3d-a805-3a395f569a65 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:03.822608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81609a-26ad-4a3d-a805-3a395f569a65 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:03.822883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81609a-26ad-4a3d-a805-3a395f569a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:03.851892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4d81609a-26ad-4a3d-a805-3a395f569a65 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:03.853318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4d81609a-26ad-4a3d-a805-3a395f569a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:03.867705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3cf57be8ce4fb38a82f81ebd18269d', 'request_id': 'req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.874251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3cf57be8ce4fb38a82f81ebd18269d', 'request_id': 'req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.888607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3cf57be8ce4fb38a82f81ebd18269d', 'request_id': 'req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.906866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] The token cache is being invalidate because project 5f3cf57be8ce4fb38a82f81ebd18269d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:03.907355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.909259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:03.911433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 961/1941] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:03 2022] DELETE /identity/v3/projects/5f3cf57be8ce4fb38a82f81ebd18269d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:03.915089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:03.916940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:03.940248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 981/1942] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:03.948812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:03.949249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:03.949440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.004411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.007375 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.029661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84fbc3-aeee-4fd4-96c9-4cc0cc975ac9 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.033027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 982/1943] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:04.034054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.035398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.037303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.038308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.038699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.039129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] PATH_INFO: `/v3/users/f7bd9d50f95b4537b864d0b3c572d1d7` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.040466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bd9d50f95b4537b864d0b3c572d1d7)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.042851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.049246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b82dd-0b23-4d25-baa5-c2b6042b7956 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.053633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.054498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.054780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.055055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] PATH_INFO: `/v3/projects/b619c299bd59424c87a3da42a2053008` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.056252 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b619c299bd59424c87a3da42a2053008)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.058280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.098202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bd9d50f95b4537b864d0b3c572d1d7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.106366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bd9d50f95b4537b864d0b3c572d1d7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.112949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b619c299bd59424c87a3da42a2053008', 'request_id': 'req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.113762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bd9d50f95b4537b864d0b3c572d1d7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.114605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bd9d50f95b4537b864d0b3c572d1d7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.115316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bd9d50f95b4537b864d0b3c572d1d7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.120766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b619c299bd59424c87a3da42a2053008', 'request_id': 'req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.128313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b619c299bd59424c87a3da42a2053008', 'request_id': 'req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.138712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 962/1944] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:03 2022] DELETE /identity/v3/users/f7bd9d50f95b4537b864d0b3c572d1d7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:04.139906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.141629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.145226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] The token cache is being invalidate because project b619c299bd59424c87a3da42a2053008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:04.145537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.148406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-168ff2dc-7e35-42e5-8c4d-3d1140dc3e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.150896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 983/1945] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:04 2022] DELETE /identity/v3/projects/b619c299bd59424c87a3da42a2053008 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:04.156070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41379b-626c-43ec-9a6e-4df6a53ac525 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.156358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41379b-626c-43ec-9a6e-4df6a53ac525 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.156639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41379b-626c-43ec-9a6e-4df6a53ac525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.175894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4d41379b-626c-43ec-9a6e-4df6a53ac525 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.177136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4d41379b-626c-43ec-9a6e-4df6a53ac525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.253182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 984/1946] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:04.254159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf5f76-01dc-4f91-a44f-24062ddf374e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.258976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.260074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.260397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.260677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.261343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.261804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.261923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:04.262083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.262315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.264699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.277452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 963/1947] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:04.281730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.281854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.283109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.283497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.296214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 985/1948] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:04.297281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.299598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24e6f-6c83-47f6-bf07-7f10e63c48ee admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.305884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.306551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.306999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.307281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.308271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.308380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc61cd-0994-4769-97ab-57287269c11f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.313631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.314081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.314936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.315159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.315510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.316317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:04.316731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.318547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.346992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 986/1949] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:04.352529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.362986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 964/1950] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:04.364975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741586f-4799-4374-b7dc-31b5aaea0917 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.367615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.452513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf7cb1-1e09-4dd4-b8e8-c9ae56f3ac8f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.458221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.460437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.460701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.461047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.462337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.465067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.469412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.470564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.471779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.472285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.474310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.478460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.487705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 965/1951] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:04.492075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.504944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7221-fb61-4f97-9b96-e7b8bae74697 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.509706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.510378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.510661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.511443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.512177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.514075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.520733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 987/1952] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:04.522893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.524880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 966/1953] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:04.525125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.525750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.538010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716f20-0b45-4ecb-90dc-173e4877786a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.594554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07f198-1417-468c-a1cf-21d9581b38b6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.599739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.600601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.600910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.601183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] PATH_INFO: `/v3/projects/4137547f225742959893d408c3f31247` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.602387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4137547f225742959893d408c3f31247)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.604482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.607599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.608305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.608589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.608850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.609629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.612105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.634994 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 967/1954] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:04.635767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.647376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160d95b-b230-4d5b-ba7e-8a106dd4efca admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.652893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4137547f225742959893d408c3f31247', 'request_id': 'req-c88ee69c-40a1-4ea7-bd92-e6b152576411'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.659575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4137547f225742959893d408c3f31247', 'request_id': 'req-c88ee69c-40a1-4ea7-bd92-e6b152576411'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.667516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4137547f225742959893d408c3f31247', 'request_id': 'req-c88ee69c-40a1-4ea7-bd92-e6b152576411'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.681758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] The token cache is being invalidate because project 4137547f225742959893d408c3f31247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:04.682114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.682719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:04.684316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 988/1955] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:04 2022] DELETE /identity/v3/projects/4137547f225742959893d408c3f31247 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:04.685119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.686508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.712014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.712688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.712970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.713354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.713977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.715558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4360d1-33dd-4157-970d-faa9c3443164 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.725961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 968/1956] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:04.727386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.727386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.727622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.745046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.746302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.750459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ee69c-40a1-4ea7-bd92-e6b152576411 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.762075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 969/1957] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:04.762075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.762307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.762307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.762307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.762307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.762585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.762655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.762655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73296f-8a91-4c2b-9872-70a9747fa9ff admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.770813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347cb08-53d6-4759-9061-051d547d4418 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.774219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 989/1958] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:04.774219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.774219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.774219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.780263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.781151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.781461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.781730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] PATH_INFO: `/v3/projects/ebb012e6d34047d8af65040bea626dd5/users/9879c7db272d40618d260fd92e4be031/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.792158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.793453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.799492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb012e6d34047d8af65040bea626dd5, user_id=9879c7db272d40618d260fd92e4be031, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.802317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.807583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 990/1959] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:04.808491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.818416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ffebf-ed92-46c1-9cae-8299b6248613 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.825292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 970/1960] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:04 2022] PUT /identity/v3/projects/ebb012e6d34047d8af65040bea626dd5/users/9879c7db272d40618d260fd92e4be031/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:04.828077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.888888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.889619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.889959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.890413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.891226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.893024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea4244-dc6c-4708-abe4-d6da4b458681 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.905764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 991/1961] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:04.906206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d913468-3bd5-487b-927f-b0346a432cd6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.906512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003917-c139-4c6b-aeaf-93cad75f526c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.906805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003917-c139-4c6b-aeaf-93cad75f526c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.907082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003917-c139-4c6b-aeaf-93cad75f526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.912790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.915124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.915640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.916143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.917100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:04.917641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.919731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:04.939527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a5003917-c139-4c6b-aeaf-93cad75f526c None None] MFA Rules not processed for user `9879c7db272d40618d260fd92e4be031`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:04.940827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a5003917-c139-4c6b-aeaf-93cad75f526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:04.943417 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 971/1962] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:04.944670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:04.958210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366115d-d800-4dd3-bfd8-931e41666cba admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:04.964504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:04.965800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:04.966822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:04.967410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] PATH_INFO: `/v3/projects/614d448623c04d6ba6f08e1752b28273/users/a5876d477f6d45ddb1f1f68a05c06abd/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:04.987833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=614d448623c04d6ba6f08e1752b28273, user_id=a5876d477f6d45ddb1f1f68a05c06abd, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:04.991405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.017995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 972/1963] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:04 2022] PUT /identity/v3/projects/614d448623c04d6ba6f08e1752b28273/users/a5876d477f6d45ddb1f1f68a05c06abd/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:05.018576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.059477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 992/1964] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:05.059477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.059477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.059477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.081027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:05.082446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.116558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81804c67-9e8a-4953-b89e-68afa647fe7c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.121972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.122679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.124592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.124592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.124592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.126537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.152337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 993/1965] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:05.154006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.155114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 973/1966] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:05.157706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.162013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.220830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50613c94-9e21-40ec-bfc1-814be474f364 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.229136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4905e8-37a8-4394-8689-3bfbb5c20a96 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.236310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.236989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.237335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.237612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.238304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.241311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.265242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 974/1967] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:05.265914 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.269406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.272881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.273657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.273967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.274298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.334103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531f85-81e7-4bd4-a4e4-bfb7e53188f7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.337704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.338937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.338937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.338937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.343823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.345715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.348846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.350316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.357493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 994/1968] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:05.358677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.359866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 975/1969] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:05.370926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45609629-79d8-4066-9749-4e150fed802e service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.375882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.377029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.377426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.378900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.380812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.381616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.383582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.395106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 995/1970] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:05.395555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c786f-260a-49f8-875b-163741d88a16 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.399852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.402185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d48910-6655-418f-a498-102a5867887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.403073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48910-6655-418f-a498-102a5867887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.403436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48910-6655-418f-a498-102a5867887e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.413296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d48910-6655-418f-a498-102a5867887e admin admin] PATH_INFO: `/v3/users/9879c7db272d40618d260fd92e4be031` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.414463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9340d8-80d0-4904-9d4d-3b4a0ed0a2eb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.415534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48910-6655-418f-a498-102a5867887e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9879c7db272d40618d260fd92e4be031)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.418173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d48910-6655-418f-a498-102a5867887e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.419249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.419917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.420201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.420477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.421233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.422833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.437763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 996/1971] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:05.439022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.451176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afae96-4afc-477a-9367-4d730a69e05a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.457079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.458688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.459031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.459247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] PATH_INFO: `/v3/projects/3ed92fc3d8a3492ba4cc9db5fdb53d6e/users/6b709bc4ddc64a2e8b4336fb5a4a5a6b/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.477298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-02d48910-6655-418f-a498-102a5867887e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9879c7db272d40618d260fd92e4be031'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:05.477603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed92fc3d8a3492ba4cc9db5fdb53d6e, user_id=6b709bc4ddc64a2e8b4336fb5a4a5a6b, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.481331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca542de-60df-4de7-9faa-d1eae4b2c414 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.484941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-02d48910-6655-418f-a498-102a5867887e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9879c7db272d40618d260fd92e4be031'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:05.493161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-02d48910-6655-418f-a498-102a5867887e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9879c7db272d40618d260fd92e4be031'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:05.493630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-02d48910-6655-418f-a498-102a5867887e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9879c7db272d40618d260fd92e4be031'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:05.494289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-02d48910-6655-418f-a498-102a5867887e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9879c7db272d40618d260fd92e4be031'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:05.497184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 997/1972] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:05 2022] PUT /identity/v3/projects/3ed92fc3d8a3492ba4cc9db5fdb53d6e/users/6b709bc4ddc64a2e8b4336fb5a4a5a6b/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:05.508357 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.508841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.509153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.516469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 976/1973] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:05 2022] DELETE /identity/v3/users/9879c7db272d40618d260fd92e4be031 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:05.518342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.518568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.519979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.539557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:05.540814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.557368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] MFA Rules not processed for user `6b709bc4ddc64a2e8b4336fb5a4a5a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:05.558724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.620154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 977/1974] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:05.627652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.629156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.641766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 998/1975] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:05.647885 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.649065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:05.664924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e66448-28ed-4292-b5ba-61a75a6d145b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.671275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.672289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.672798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.681622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.682795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.686867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.701163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67374df9-daca-4762-9e9b-8ad5703f4034 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.710085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.710996 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.711357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.711763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.725176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 999/1976] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:05.726120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.726494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.727712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.740642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 978/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:05.792157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1ffe-19ba-4509-a797-d18fd26f688c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.798157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.799062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.799534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.800028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.801023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.803181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.824251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1000/1978] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:05 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:05.829050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.845524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14feb25e-0d8d-4ba7-a0b9-31ea6b5c7303 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.850429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.851105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.851389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.851661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.852448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.854098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.865603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 979/1979] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:05.869827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.880310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128630-b6ec-43b0-9472-42193ab620f4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.885225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.886405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.886722 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.887025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] PATH_INFO: `/v3/projects/faa878768b854810bcac8f2a43375ef8/users/1f7c7530d0d749c1b004b8ad005acd4f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.903010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa878768b854810bcac8f2a43375ef8, user_id=1f7c7530d0d749c1b004b8ad005acd4f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:05.906342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:05.921692 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1001/1980] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:05 2022] PUT /identity/v3/projects/faa878768b854810bcac8f2a43375ef8/users/1f7c7530d0d749c1b004b8ad005acd4f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:05.925902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:05.936149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb210-7223-4a04-aa24-64cd36620e4c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:05.997005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:05.997748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:05.998030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:05.998304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:05.999199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.000848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50c733-fdab-418a-ac7f-9639754251fe admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.016054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 980/1981] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:06.017257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.027863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154f1e-2386-4261-aa68-ce595ff3ce37 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:06.033016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:06.033942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.034222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.034494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] PATH_INFO: `/v3/projects/faa878768b854810bcac8f2a43375ef8/users/1f7c7530d0d749c1b004b8ad005acd4f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.036470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa878768b854810bcac8f2a43375ef8, user_id=1f7c7530d0d749c1b004b8ad005acd4f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.039205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.050689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1002/1982] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:06 2022] PUT /identity/v3/projects/faa878768b854810bcac8f2a43375ef8/users/1f7c7530d0d749c1b004b8ad005acd4f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:06.061691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.061985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.062264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.094017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] MFA Rules not processed for user `1f7c7530d0d749c1b004b8ad005acd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:06.095402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.189272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 981/1983] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:06.201953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.203873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.279473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97f0b4-32d3-4083-a465-955ac6e74b98 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:06.284176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:06.284836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.285153 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.285462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.297464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.299062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.308844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1003/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:06.381717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.392056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953e10-36f4-4343-824d-f40d248ae815 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:06.395935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:06.396621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.396943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.397252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.457637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.459861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f903d79-471f-46f8-b85e-f8e616cb2632 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.471193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 982/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:06.593263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.594748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.680886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86800931-ddc1-4e78-b5d0-640ba69ff163 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:06.686508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:06.687053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.687340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.687613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] PATH_INFO: `/v3/projects/ebb012e6d34047d8af65040bea626dd5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.688838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb012e6d34047d8af65040bea626dd5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.690972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.770050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb012e6d34047d8af65040bea626dd5', 'request_id': 'req-268bf928-168e-4388-9864-6d2da0309292'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:06.772005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98b58e-3cde-48e2-8b91-c124225808a1 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.772425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98b58e-3cde-48e2-8b91-c124225808a1 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.772806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98b58e-3cde-48e2-8b91-c124225808a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.778908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb012e6d34047d8af65040bea626dd5', 'request_id': 'req-268bf928-168e-4388-9864-6d2da0309292'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:06.791948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb012e6d34047d8af65040bea626dd5', 'request_id': 'req-268bf928-168e-4388-9864-6d2da0309292'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:06.818947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ab98b58e-3cde-48e2-8b91-c124225808a1 None None] MFA Rules not processed for user `a5876d477f6d45ddb1f1f68a05c06abd`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:06.820249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ab98b58e-3cde-48e2-8b91-c124225808a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.822717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] The token cache is being invalidate because project ebb012e6d34047d8af65040bea626dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:06.823022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:06.823672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:06.829860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1004/1986] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:06 2022] DELETE /identity/v3/projects/ebb012e6d34047d8af65040bea626dd5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:06.829860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.829860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.916344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 983/1987] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:06.922848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.923432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.923890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.927979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf928-168e-4388-9864-6d2da0309292 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:06.941141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:06.942081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:06.942361 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:06.942632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] PATH_INFO: `/v3/users/6b709bc4ddc64a2e8b4336fb5a4a5a6b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:06.944945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b709bc4ddc64a2e8b4336fb5a4a5a6b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:06.947597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:06.948692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:06.950234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:06.968902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 984/1988] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:06.970077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:06.972338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.025973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b709bc4ddc64a2e8b4336fb5a4a5a6b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.035807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b709bc4ddc64a2e8b4336fb5a4a5a6b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.048171 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b709bc4ddc64a2e8b4336fb5a4a5a6b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.049389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b709bc4ddc64a2e8b4336fb5a4a5a6b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.050855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17bb2-497a-4662-8b2a-2d27a9b5b7f9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.054692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.055404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.055689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.055966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.058995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.066431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d3c64998-2159-4252-8f86-b3fef6ee9b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b709bc4ddc64a2e8b4336fb5a4a5a6b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.073442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.074880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c8e1-29ce-4f18-9d43-dc4b75715bcf service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.075215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1005/1989] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:06 2022] DELETE /identity/v3/users/6b709bc4ddc64a2e8b4336fb5a4a5a6b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:07.078945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.079415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.079867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.090686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 985/1990] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:07.092716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.093016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.093309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.112795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:07.114109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.131341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:07.133249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.181120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 986/1991] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:07.192572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.194916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.223820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1006/1992] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:07.228035 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.238383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956aecd-6b9c-45e9-9aac-1959e90096ad None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.244091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.244792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.245078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.245405 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.246137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:07.246470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.248730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.259407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ea4e5-c467-4f28-bc2c-5cec3f97e441 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.261696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1007/1993] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:07.266689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.268240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.269088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.269408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.269685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.279034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb8b5-da33-4a8a-b729-0c5effbe81e6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.286625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.286880 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.287371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.287677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.287958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.288727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.288838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.291111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.302982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 987/1994] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:07.330012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1008/1995] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:07 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:07.334218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.350027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edd02-6401-474b-a2a4-63e06dad9404 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.457731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.458543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.459063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.459727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.460637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.463400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.511349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 988/1996] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:07 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:07.514706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.552995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2620-52f5-423a-9acd-b739bdf3cbdf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.561183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.562203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.563179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.563179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.563512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.567204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.581286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1009/1997] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:07.585145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.596628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc07f-65d7-4b72-91e8-98690cf34f75 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.601450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.602145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.602585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.602867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.603582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.605246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.617257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 989/1998] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:07.622256 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.634312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c4f5-5363-439e-82fd-056350f13591 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.641442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.642579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.642871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.643156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] PATH_INFO: `/v3/projects/cd99e2b4212b4168b970054088492af0/users/36abee8c883d453c8aaf9dc99a18d4d4/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.652490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.654573 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.664455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd99e2b4212b4168b970054088492af0, user_id=36abee8c883d453c8aaf9dc99a18d4d4, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.667487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b421f-fe81-449c-851f-91fee4e96894 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.680959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e96010-9631-4bdc-9bb6-947c81ac77cb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.688149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1010/1999] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:07 2022] PUT /identity/v3/projects/cd99e2b4212b4168b970054088492af0/users/36abee8c883d453c8aaf9dc99a18d4d4/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:07.699288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.699580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.699959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.733372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] MFA Rules not processed for user `36abee8c883d453c8aaf9dc99a18d4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:07.734633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.760148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.761653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.761965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.762290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] PATH_INFO: `/v3/projects/3ed92fc3d8a3492ba4cc9db5fdb53d6e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.763553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed92fc3d8a3492ba4cc9db5fdb53d6e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.765726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.819641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1011/2000] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:07.827858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed92fc3d8a3492ba4cc9db5fdb53d6e', 'request_id': 'req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.830913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.832494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.835708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed92fc3d8a3492ba4cc9db5fdb53d6e', 'request_id': 'req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.844013 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed92fc3d8a3492ba4cc9db5fdb53d6e', 'request_id': 'req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.859390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] The token cache is being invalidate because project 3ed92fc3d8a3492ba4cc9db5fdb53d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:07.859826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.860491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.862116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 990/2001] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:07 2022] DELETE /identity/v3/projects/3ed92fc3d8a3492ba4cc9db5fdb53d6e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:07.866357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:07.867682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.895978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa0d83-3fd4-4dae-b5fc-07a2e8b01638 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.932024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f45e-d5ae-4f3f-a743-04fa2c8fd377 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:07.937496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.938394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.938678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.938957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] PATH_INFO: `/v3/users/1f7c7530d0d749c1b004b8ad005acd4f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.940150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7c7530d0d749c1b004b8ad005acd4f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:07.942185 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:07.944200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:07.944857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:07.945146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:07.945457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:07.947446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:07.988543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7c7530d0d749c1b004b8ad005acd4f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:07.995473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7c7530d0d749c1b004b8ad005acd4f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.002781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7c7530d0d749c1b004b8ad005acd4f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.003767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7c7530d0d749c1b004b8ad005acd4f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.004569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-4729569f-3412-4ce4-bc66-85e0a5326d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7c7530d0d749c1b004b8ad005acd4f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.007292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.009065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.018680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1012/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:08.023058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 991/2003] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:07 2022] DELETE /identity/v3/users/1f7c7530d0d749c1b004b8ad005acd4f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:08.330933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:08.343257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992364-0c54-4d52-a9b7-1e53d2d5a22e service glance] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:08.403044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:08.404462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.404746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.405028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] PATH_INFO: `/v3/projects/faa878768b854810bcac8f2a43375ef8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.406319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa878768b854810bcac8f2a43375ef8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.408220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.458444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa878768b854810bcac8f2a43375ef8', 'request_id': 'req-6f769c5f-c16e-457e-ae20-e76d3ca508f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.466577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa878768b854810bcac8f2a43375ef8', 'request_id': 'req-6f769c5f-c16e-457e-ae20-e76d3ca508f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.473509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa878768b854810bcac8f2a43375ef8', 'request_id': 'req-6f769c5f-c16e-457e-ae20-e76d3ca508f4'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.508301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] The token cache is being invalidate because project faa878768b854810bcac8f2a43375ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:08.508602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.509466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6f769c5f-c16e-457e-ae20-e76d3ca508f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:08.511439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1013/2004] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:08 2022] DELETE /identity/v3/projects/faa878768b854810bcac8f2a43375ef8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:08.516963 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a939-0c71-45db-b670-6e7ebee1adde None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.517545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a939-0c71-45db-b670-6e7ebee1adde None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.521053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77a939-0c71-45db-b670-6e7ebee1adde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.557686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2d77a939-0c71-45db-b670-6e7ebee1adde None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:08.559084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2d77a939-0c71-45db-b670-6e7ebee1adde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:08.627421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.627867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.628034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.648396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] MFA Rules not processed for user `a5876d477f6d45ddb1f1f68a05c06abd`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:08.649748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:08.654650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 992/2005] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:08.662207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.662501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.662792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.695168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:08.696917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:08.710953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 993/2006] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:08.712167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:08.718129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1014/2007] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:08.725799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecd921-637f-4eb0-a0dc-9fa843b154eb None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:08.731703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:08.732372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.732657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.732934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.734321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:08.734430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.736012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.753705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 994/2008] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:08.758420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:08.773859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b938d0-6d54-4e94-8cb7-ce8cfa614761 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:08.780289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:08.781377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.781670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.781951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.782653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.784656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.825030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1015/2009] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:08 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:08.829846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:08.840579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4d86-b9af-40b5-95f3-5facd3051027 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:08.905615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:08.906355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.906647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.906926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.907785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.909949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.941916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 995/2010] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:08 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:08.943222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:08.958550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0087-7f9c-4235-a6a2-e21ead727972 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:08.963921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:08.964536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:08.964829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:08.965121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:08.966059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:08.967709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:08.978920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1016/2011] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:08.984009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.006864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f78d-c03d-454b-a250-315efcd41fa1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.012650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.014281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.026562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.027402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.028197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.031171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e90a0-a1ea-4e20-b62f-340e8ef8ffed admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.045284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 996/2012] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:09.048284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.062752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6421792-92fa-4730-84cf-4d893905bf19 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.067923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.068843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.069127 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.069431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] PATH_INFO: `/v3/projects/ae33550d38a24543991e63145b888705/users/1275df573e334618aaa0b2430d6e243f/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.087846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae33550d38a24543991e63145b888705, user_id=1275df573e334618aaa0b2430d6e243f, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.090806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.104355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1017/2013] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:09 2022] PUT /identity/v3/projects/ae33550d38a24543991e63145b888705/users/1275df573e334618aaa0b2430d6e243f/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:09.116702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.117003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.117410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.144247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] MFA Rules not processed for user `1275df573e334618aaa0b2430d6e243f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:09.145626 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:09.212964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 997/2014] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:09.218345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.285459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91ede7-1987-4029-8810-dbbf73a19f14 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.291272 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.291949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.292404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.292690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.293449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.295955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.328429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1018/2015] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:09.329909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.341726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0007ca-78ad-4e12-8c8c-17c7ce8832d3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.416966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.418295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.418295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.418295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.419444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.421673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.447981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 998/2016] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:09 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:09.450091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.464112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1824c3-b44d-4304-a0d3-a3e7cf768e9f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.473515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.474287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.474637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.474976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.475781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.477483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.490227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1019/2017] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:09.495006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.505375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda7d90-1bf1-4628-928e-ccc5b888715c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.510753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.512059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.512361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.512602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] PATH_INFO: `/v3/projects/970b73ce4154458e946e069105db324f/users/0aea742fce9f4226944b8b97087c9ce5/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.530017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970b73ce4154458e946e069105db324f, user_id=0aea742fce9f4226944b8b97087c9ce5, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.534854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.554199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 999/2018] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:09 2022] PUT /identity/v3/projects/970b73ce4154458e946e069105db324f/users/0aea742fce9f4226944b8b97087c9ce5/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:09.559523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.573727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0d1eb-736d-4eed-871a-83997f5a7248 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.685959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.687021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.687319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.687776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.688653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.690708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f47bb-ce7d-4a67-8c40-755b9e559bd2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.710364 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.717786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1020/2019] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:09.724866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d9db3-495c-4bbd-9f8a-38b19dbaeef6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:09.730113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:09.731250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.731624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.732606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] PATH_INFO: `/v3/projects/970b73ce4154458e946e069105db324f/users/0aea742fce9f4226944b8b97087c9ce5/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.736206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=970b73ce4154458e946e069105db324f, user_id=0aea742fce9f4226944b8b97087c9ce5, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:09.739851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:09.755003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1000/2020] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:09 2022] PUT /identity/v3/projects/970b73ce4154458e946e069105db324f/users/0aea742fce9f4226944b8b97087c9ce5/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:09.769261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:09.769261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:09.769261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:09.806781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] MFA Rules not processed for user `0aea742fce9f4226944b8b97087c9ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:09.808102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:09.908658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1021/2021] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:09.925419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:09.927678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:10.042027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f090-3673-4e1d-ae24-a7bc8bff8aed admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:10.047367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:10.047979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:10.048352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:10.049190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:10.148380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:10.150601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:10.161667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1001/2022] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:11.044612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:11.046085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.107704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e5ed-7567-4e48-9fc8-9979f91adcd6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:11.112245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:11.113104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.113410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.113681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] PATH_INFO: `/v3/users/4b14b25d1fd843dd823e4a89e4d0391c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.115108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b14b25d1fd843dd823e4a89e4d0391c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:11.117391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:11.149983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:11.152654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.167183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582de924-dcd7-4df4-9acf-682f0dac1e30 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:11.170467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b14b25d1fd843dd823e4a89e4d0391c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.172330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:11.173248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.173514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.173787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] PATH_INFO: `/v3/users/7a4cd1576ee74fe49c930ac93adc18aa` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.175093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4cd1576ee74fe49c930ac93adc18aa)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:11.176998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:11.177176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b14b25d1fd843dd823e4a89e4d0391c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.185484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b14b25d1fd843dd823e4a89e4d0391c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.186104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b14b25d1fd843dd823e4a89e4d0391c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.200630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48ed7c04-11bb-47fd-8e4c-fe36cb4b1326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b14b25d1fd843dd823e4a89e4d0391c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.207036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1022/2023] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:11 2022] DELETE /identity/v3/users/4b14b25d1fd843dd823e4a89e4d0391c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:11.232132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4cd1576ee74fe49c930ac93adc18aa'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.241320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4cd1576ee74fe49c930ac93adc18aa'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.249555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4cd1576ee74fe49c930ac93adc18aa'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.250253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4cd1576ee74fe49c930ac93adc18aa'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.250877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4cd1576ee74fe49c930ac93adc18aa'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:11.274481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1002/2024] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:11 2022] DELETE /identity/v3/users/7a4cd1576ee74fe49c930ac93adc18aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:11.279215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.279509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.280003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.301404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:11.302730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.366748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1023/2025] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:11.378323 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:11.380048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.457164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0a22-c990-440e-88fe-40953a0ef8bf admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:11.462640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:11.463319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.463621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.463887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.473786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:11.475243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:11.486629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1003/2026] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:11.880056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:11.881700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.902952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516d35c-f034-4795-9f21-75f2a99ad377 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:11.907833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:11.909536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:11.923180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:11.924004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.924317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.924619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] PATH_INFO: `/v3/projects/d97e7a20bec440258d7efc3fac4dff54` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.925853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97e7a20bec440258d7efc3fac4dff54)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:11.926402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc2936-30e3-4b73-853b-f0d3759791dc service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:11.928026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:11.954629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:11.955442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:11.955729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:11.956002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] PATH_INFO: `/v3/projects/39b249a6fe6240c69bc1252aaf666c24` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:11.957369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b249a6fe6240c69bc1252aaf666c24)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:11.959574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:11.990673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97e7a20bec440258d7efc3fac4dff54', 'request_id': 'req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.005490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97e7a20bec440258d7efc3fac4dff54', 'request_id': 'req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.013674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97e7a20bec440258d7efc3fac4dff54', 'request_id': 'req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.026640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b249a6fe6240c69bc1252aaf666c24', 'request_id': 'req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.028810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] The token cache is being invalidate because project d97e7a20bec440258d7efc3fac4dff54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:12.029116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.030023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b6c6a070-ef56-476a-904b-0c5f92c9b2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.034608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1024/2027] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:11 2022] DELETE /identity/v3/projects/d97e7a20bec440258d7efc3fac4dff54 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:12.037268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1623e0-7239-4125-b306-50673106b33d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.037588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1623e0-7239-4125-b306-50673106b33d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.037867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1623e0-7239-4125-b306-50673106b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.040924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b249a6fe6240c69bc1252aaf666c24', 'request_id': 'req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.049863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b249a6fe6240c69bc1252aaf666c24', 'request_id': 'req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.058037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-1e1623e0-7239-4125-b306-50673106b33d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.060948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1e1623e0-7239-4125-b306-50673106b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.061834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] The token cache is being invalidate because project 39b249a6fe6240c69bc1252aaf666c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:12.062174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.062828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b546a8d1-2dfa-4d7b-95a0-4eaed81c2556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:12.064631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1004/2028] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:11 2022] DELETE /identity/v3/projects/39b249a6fe6240c69bc1252aaf666c24 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:12.069822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab13397-ec03-493d-bbfc-a721c806c515 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.069822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab13397-ec03-493d-bbfc-a721c806c515 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.070051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab13397-ec03-493d-bbfc-a721c806c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.096027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7ab13397-ec03-493d-bbfc-a721c806c515 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.097384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7ab13397-ec03-493d-bbfc-a721c806c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.133081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1025/2029] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:12.141336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.141909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.142207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.162292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.163092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1005/2030] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:12.163656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.171333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.171742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.172143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.177750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1026/2031] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:12.181530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.191250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.192192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32530-6f41-450d-aeb2-ba7954060279 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.192542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.198095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.199314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.199754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.200307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.201318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:12.201955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.204947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.207339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1006/2032] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:12.211490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.219313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1027/2033] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:12.220440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402518-6ed0-4211-b7bb-1d5732902ffc None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.223581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.225366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.226170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.226454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.226725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.227471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:12.227775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.229387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.234398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972213-474f-418f-b478-8f930c1941a9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.240006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.240661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.241014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.241250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.241949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.246514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1007/2034] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:12.246664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.252344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.267470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a4b7-646d-4a0f-8724-8c0a67b04cf5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.273380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.274202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.274610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.274974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.275764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.278256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.283120 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1028/2035] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:12.287924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.316274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1008/2036] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:12.320496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.364575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1c718-10db-4d08-a9c7-f2e60c412852 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.388604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb6458-a79a-457b-ad40-733763cf845d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.393547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.394277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.394631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.394831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.395735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.397810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.424804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.425512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.425794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.427265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1009/2037] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:12.429598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.430776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.432227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.433499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.443090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63dd7d-9b6f-471f-8ec1-c290cb7a1762 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.449887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.450696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.451074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.451601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.452675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.454505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.459003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1029/2038] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/users => generated 280 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:12.460040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.468469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1010/2039] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:12.469615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.473502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f62763-b644-43f4-b39a-1eb77b377c07 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.481276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d294-09bb-4056-bff6-b518f87c393c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.483001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.483404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.483760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.484110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.484921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.486665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.487191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.487864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.488150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.488634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.489406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.491093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.498210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1030/2040] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:12.502406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.504443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1011/2041] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:12.508462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.514349 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3e524-6eda-40c3-b92d-93f7321eed75 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.519160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.519816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.519942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630daa55-2af2-4dc1-aafd-23172279d0d9 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.520102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.520374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.521121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.522856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.526481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.527376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.527663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.527941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] PATH_INFO: `/v3/projects/08e3ba9cd15d4f46a0c1b52f7eefbafa/users/653c3b221e394f8ab4ea6614f074e025/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.538347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1031/2042] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:12.544674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.554715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3ba9cd15d4f46a0c1b52f7eefbafa, user_id=653c3b221e394f8ab4ea6614f074e025, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.555959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c851-51f0-4950-891c-973862a50b06 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.557953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bcc03-eaed-4ce2-844f-fcff6450d3fc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.560928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.562172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.562536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.562820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] PATH_INFO: `/v3/projects/9ae1fe0f98cd4f92b29c201bfc50c30e/users/62070c67e52742b982527f9c83ed459e/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.572146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1012/2043] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:12 2022] PUT /identity/v3/projects/08e3ba9cd15d4f46a0c1b52f7eefbafa/users/653c3b221e394f8ab4ea6614f074e025/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:12.581308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae1fe0f98cd4f92b29c201bfc50c30e, user_id=62070c67e52742b982527f9c83ed459e, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.581308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a02a3a-bae5-48e2-a44d-86408b324b28 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.583450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.584712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.585096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.598775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1032/2044] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:12 2022] PUT /identity/v3/projects/9ae1fe0f98cd4f92b29c201bfc50c30e/users/62070c67e52742b982527f9c83ed459e/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:12.610330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.610624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.610903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.619112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] MFA Rules not processed for user `653c3b221e394f8ab4ea6614f074e025`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.620405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.637437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] MFA Rules not processed for user `62070c67e52742b982527f9c83ed459e`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:12.638847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.695460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1013/2045] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:12.708312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.710490 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.739828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1033/2046] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:12.779614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.781077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.781439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34d3c-9d34-4074-88e8-313f2612cad8 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.785113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.785799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.786511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.786817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.796376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.797939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.807975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1014/2047] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:12.811089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71040023-5cc3-4971-a8c9-cbff908dccad None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.815213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.815782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.816068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.816703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.827508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.828777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:12.842731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1034/2048] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:12.861547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.952934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:12.955047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:12.974578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761dd6-33b6-4771-92fa-653f56555bba service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:12.979968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:12.981955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:12.982442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:12.982854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] PATH_INFO: `/v3/users/62070c67e52742b982527f9c83ed459e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:12.985406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=62070c67e52742b982527f9c83ed459e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:12.987535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.047269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54cc0c-aac9-4f76-9572-9991ad0d4049 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:13.062049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:13.063053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.063339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.063615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] PATH_INFO: `/v3/users/1275df573e334618aaa0b2430d6e243f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.065078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1275df573e334618aaa0b2430d6e243f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:13.065231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62070c67e52742b982527f9c83ed459e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.067352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.079620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62070c67e52742b982527f9c83ed459e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.100088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62070c67e52742b982527f9c83ed459e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.101294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62070c67e52742b982527f9c83ed459e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.102186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6aa15e25-139b-4113-a830-e2f69f56a3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62070c67e52742b982527f9c83ed459e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.139252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1015/2049] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:12 2022] DELETE /identity/v3/users/62070c67e52742b982527f9c83ed459e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:13.142019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1275df573e334618aaa0b2430d6e243f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.143570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.145025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.145532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.151132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1275df573e334618aaa0b2430d6e243f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.163788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1275df573e334618aaa0b2430d6e243f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.164840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1275df573e334618aaa0b2430d6e243f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.171325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:13.172940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.192941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f82a1039-e5f7-484c-8ef5-34812cb51338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1275df573e334618aaa0b2430d6e243f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.198532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1035/2050] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:12 2022] DELETE /identity/v3/users/1275df573e334618aaa0b2430d6e243f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:13.204499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d841-d665-4130-a69e-c22359443b75 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.205061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d841-d665-4130-a69e-c22359443b75 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.205550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d841-d665-4130-a69e-c22359443b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.240794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2047d841-d665-4130-a69e-c22359443b75 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:13.242854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2047d841-d665-4130-a69e-c22359443b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.261411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1016/2051] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:13.276610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:13.282156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.357133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1036/2052] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:13.367897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d841-d665-4130-a69e-c22359443b75 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:13.369805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2047d841-d665-4130-a69e-c22359443b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.395348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c3066-7d5d-4087-80a3-cae4653a3f24 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:13.440761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d841-d665-4130-a69e-c22359443b75 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:13.446070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:13.446650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:13.446969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.447302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.447396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.447582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.447855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.447968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.457161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:13.458347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:13.458635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.460618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.469116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1017/2053] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:13.472108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1037/2054] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:13.867046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:13.868727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.880354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:13.881803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:13.903986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544b8f-a637-4200-a7ea-ef409a88067d service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:13.905275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf0e2b-e641-423f-b9bd-8eac9a79dad2 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:13.913348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:13.914794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.915078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.915392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] PATH_INFO: `/v3/projects/ae33550d38a24543991e63145b888705` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.916530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:13.917458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:13.917677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:13.917945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] PATH_INFO: `/v3/projects/9ae1fe0f98cd4f92b29c201bfc50c30e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:13.920033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae33550d38a24543991e63145b888705)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:13.921262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.922773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae1fe0f98cd4f92b29c201bfc50c30e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:13.926623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:13.987660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae33550d38a24543991e63145b888705', 'request_id': 'req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:13.998234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae33550d38a24543991e63145b888705', 'request_id': 'req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.001397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae1fe0f98cd4f92b29c201bfc50c30e', 'request_id': 'req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.007926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae1fe0f98cd4f92b29c201bfc50c30e', 'request_id': 'req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.011855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae33550d38a24543991e63145b888705', 'request_id': 'req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.021251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae1fe0f98cd4f92b29c201bfc50c30e', 'request_id': 'req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.023808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] The token cache is being invalidate because project ae33550d38a24543991e63145b888705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:14.024094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.024710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.026725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1018/2055] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:13 2022] DELETE /identity/v3/projects/ae33550d38a24543991e63145b888705 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:14.030510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.032136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.037769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] The token cache is being invalidate because project 9ae1fe0f98cd4f92b29c201bfc50c30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:14.038061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.038688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-79cfbab3-d5f1-4f1c-a716-8b36d7581e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.040799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1038/2056] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:13 2022] DELETE /identity/v3/projects/9ae1fe0f98cd4f92b29c201bfc50c30e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:14.047417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760b80-e37d-4f84-a5dc-5c7e0341ffc1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.047417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760b80-e37d-4f84-a5dc-5c7e0341ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.047417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760b80-e37d-4f84-a5dc-5c7e0341ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.067565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-36760b80-e37d-4f84-a5dc-5c7e0341ffc1 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:14.069589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36760b80-e37d-4f84-a5dc-5c7e0341ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.109458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fe269-a6dc-4a1c-9c12-3884d817cde7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.141513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1039/2057] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:14.143056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.143344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.143622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.160757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:14.162010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.166173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.167045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.167328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.167608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] PATH_INFO: `/v3/users/0aea742fce9f4226944b8b97087c9ce5` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.168806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aea742fce9f4226944b8b97087c9ce5)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.170775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.171408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1040/2058] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:14.175203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.184232 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2809fe-800d-4ec5-87dd-e874e9d41a61 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.192822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.193531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.193813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.194087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.194817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:14.195123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.197144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.211291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1041/2059] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:14.215714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.223673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aea742fce9f4226944b8b97087c9ce5'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.226072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26732d50-4c5e-4e48-b1a4-75e47eca20bd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.231323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.232006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aea742fce9f4226944b8b97087c9ce5'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.232134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.232503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.232873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.233676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.235666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.239568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aea742fce9f4226944b8b97087c9ce5'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.240259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aea742fce9f4226944b8b97087c9ce5'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.240879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aea742fce9f4226944b8b97087c9ce5'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.264014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1019/2060] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:14 2022] DELETE /identity/v3/users/0aea742fce9f4226944b8b97087c9ce5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:14.267815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1042/2061] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:14.272265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.274033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.352202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc757-3833-4391-88f2-c629d6ebe67d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.429998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.430803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.431151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.431529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.432301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.434559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.466399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1020/2062] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:14.470464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.481861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186093c-64f4-4825-93d8-5396b3456834 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.488030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.488856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.491894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.491894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.491894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.492307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.505588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1043/2063] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:14.508170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.519482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0299012-84da-48e1-9c3d-f83075e40266 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.525009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.525697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.526010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.526271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.527025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.529126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba00eaa-a015-4ad2-8322-e6fd89d93390 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.549393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1021/2064] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:14.550589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.563399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d9b39-b2ba-4548-a846-cae42aef7e08 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.568541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.569299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.569587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.569858 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] PATH_INFO: `/v3/projects/11dac266787e4040ae4f5ebc56922c58/users/c2cdda0d9cff44238f04ad13ae945aa8/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.586303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11dac266787e4040ae4f5ebc56922c58, user_id=c2cdda0d9cff44238f04ad13ae945aa8, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.589162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.604224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1044/2065] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:14 2022] PUT /identity/v3/projects/11dac266787e4040ae4f5ebc56922c58/users/c2cdda0d9cff44238f04ad13ae945aa8/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:14.615615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.615930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.616946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.643220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.645305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.653584 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] MFA Rules not processed for user `c2cdda0d9cff44238f04ad13ae945aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:14.654775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.753949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee96b5-1d6f-4111-866b-e3a1cc60e045 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.757113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1022/2066] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:14.760122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.761707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.762166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.762672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] PATH_INFO: `/v3/projects/970b73ce4154458e946e069105db324f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.764645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=970b73ce4154458e946e069105db324f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.767094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:14.768575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.769365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.830207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970b73ce4154458e946e069105db324f', 'request_id': 'req-45080aad-e63c-437a-ac8a-493c0539ef8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.836604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970b73ce4154458e946e069105db324f', 'request_id': 'req-45080aad-e63c-437a-ac8a-493c0539ef8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.844856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6996f-e4bf-4d01-ba17-c505e3bed630 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:14.845430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970b73ce4154458e946e069105db324f', 'request_id': 'req-45080aad-e63c-437a-ac8a-493c0539ef8f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.860365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] The token cache is being invalidate because project 970b73ce4154458e946e069105db324f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:14.860931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.862038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45080aad-e63c-437a-ac8a-493c0539ef8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:14.863985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1045/2067] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:14 2022] DELETE /identity/v3/projects/970b73ce4154458e946e069105db324f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:14.868590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dba7a-f279-48e3-824d-64c7033b9567 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.869685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dba7a-f279-48e3-824d-64c7033b9567 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.869895 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dba7a-f279-48e3-824d-64c7033b9567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.889362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d69dba7a-f279-48e3-824d-64c7033b9567 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:14.890580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d69dba7a-f279-48e3-824d-64c7033b9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.898653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:14.899319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.899727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.899953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.901836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:14.960771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1046/2068] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:14.968261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52973036-9a97-4489-8180-7d150a734066 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:14.968590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52973036-9a97-4489-8180-7d150a734066 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:14.968851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52973036-9a97-4489-8180-7d150a734066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:14.976378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:14.977846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:14.987538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1023/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:15.003422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-52973036-9a97-4489-8180-7d150a734066 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:15.005048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-52973036-9a97-4489-8180-7d150a734066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:15.018386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1047/2070] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:15.019575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.033785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e0b0-7a8c-42db-8b07-e8a03eadc802 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.039418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.040210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.040653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.040930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.041715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:15.042076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.043776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.062469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1024/2071] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:15.063699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52973036-9a97-4489-8180-7d150a734066 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.076745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52973036-9a97-4489-8180-7d150a734066 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.083141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.083888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.084143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.084532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.085190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.087289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.133260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1048/2072] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:15 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:15.135805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.146669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc8979-53f5-4e19-8ff8-b44560806354 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.233138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.234145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.234474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.234749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.235454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.237608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.270401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1025/2073] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:15 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:15.281688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.291672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55853db1-c109-4637-bfb1-6cc5889448ae admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.296916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.297626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.297911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.298184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.298936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.300542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.312208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1049/2074] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:15.315959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.326177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf97b-63c5-4153-833b-99bca3ff1be5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.331534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.332207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.332472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.332743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.333519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.335108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a437d-478c-4a5b-bd20-5366eb43f942 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.352982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1026/2075] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:15.354220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.367943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5701628-28cc-4d30-84f3-110005cec193 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.374283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.375203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.375480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.375750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] PATH_INFO: `/v3/projects/3c08e7050d804002aec023c0f3486114/users/dd0d0e5e8aaf431b8f0cb2cd08b775ac/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.396921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c08e7050d804002aec023c0f3486114, user_id=dd0d0e5e8aaf431b8f0cb2cd08b775ac, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.399746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.418510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1050/2076] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:15 2022] PUT /identity/v3/projects/3c08e7050d804002aec023c0f3486114/users/dd0d0e5e8aaf431b8f0cb2cd08b775ac/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:15.429904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.430202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.430547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.467076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] MFA Rules not processed for user `dd0d0e5e8aaf431b8f0cb2cd08b775ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:15.468318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:15.557346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1027/2077] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:15.571013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:15.573129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:15.636941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5800e-36d3-4da4-a949-f30d172d48c1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:15.640619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:15.641297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:15.641597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:15.641872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:15.649977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:15.651411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39979-3aff-4d79-8e36-f6ac08d91f40 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:15.660834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1051/2078] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:18.685905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:18.750416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bdabf-9244-4a35-9563-87b3f4d9340a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:18.755099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:18.755974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:18.756254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:18.756527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] PATH_INFO: `/v3/users/dd0d0e5e8aaf431b8f0cb2cd08b775ac` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:18.757759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0d0e5e8aaf431b8f0cb2cd08b775ac)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:18.759700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:18.815952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0d0e5e8aaf431b8f0cb2cd08b775ac'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:18.823127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0d0e5e8aaf431b8f0cb2cd08b775ac'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:18.832033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0d0e5e8aaf431b8f0cb2cd08b775ac'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:18.832725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0d0e5e8aaf431b8f0cb2cd08b775ac'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:18.833377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0d0e5e8aaf431b8f0cb2cd08b775ac'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:18.850558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1028/2079] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:18 2022] DELETE /identity/v3/users/dd0d0e5e8aaf431b8f0cb2cd08b775ac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:18.855948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:18.855948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:18.855948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:18.874157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:18.875407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:18.937479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1052/2080] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:18.947301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:18.948722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:19.010087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6fab-9085-4b05-a589-87935c606be1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.014284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.015043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.015430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.015711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.024741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.026259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa3452-fe26-43de-b88a-11c99e94d30d service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.037133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1029/2081] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:19.351854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.355341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:19.393837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2e2a-dac0-4902-87a4-398486fbcfa4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.398611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.399473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.399754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.400029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] PATH_INFO: `/v3/projects/3c08e7050d804002aec023c0f3486114` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.401229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c08e7050d804002aec023c0f3486114)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.403641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.452918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c08e7050d804002aec023c0f3486114', 'request_id': 'req-0d5c49db-f80f-49a8-ad19-faf793f18ce2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:19.459634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c08e7050d804002aec023c0f3486114', 'request_id': 'req-0d5c49db-f80f-49a8-ad19-faf793f18ce2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:19.465303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c08e7050d804002aec023c0f3486114', 'request_id': 'req-0d5c49db-f80f-49a8-ad19-faf793f18ce2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:19.478661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] The token cache is being invalidate because project 3c08e7050d804002aec023c0f3486114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:19.478956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:19.479590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0d5c49db-f80f-49a8-ad19-faf793f18ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:19.481195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1053/2082] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:19 2022] DELETE /identity/v3/projects/3c08e7050d804002aec023c0f3486114 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:19.486538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.486826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.487100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.504686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:19.505926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:19.569948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1030/2083] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:19.578212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.578549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.578854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.598286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:19.599489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:19.610208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1054/2084] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:19.614497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.624641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c0e76-c2c7-4004-9483-fe51e74ff89d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.629614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.630449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.630730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.631001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.631929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:19.632241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.633905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.646825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1031/2085] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:19.651468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.661362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b1ac-1f49-42b3-bfa5-53d14a059449 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.666057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.666703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.666988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.667261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.667956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.669931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.702575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1055/2086] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:19.707252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.717886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6c2ab-91a2-4ccf-8d2c-511438e8f7ac admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.774836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.775516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.775836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.776067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.776762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.779370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.799249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1032/2087] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:19 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:19.804228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.815984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9158734-461b-4999-a2e1-7c72c15713ed admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.821071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.822360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.822538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.823044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.823683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.825844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.844607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1056/2088] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:19.849061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.859852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53e38-481e-4dc1-b664-ca2d3bd9d0b8 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.864656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.865358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.865645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.865938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.866665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.868338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c99185-1e7c-4669-b823-4a93f376fa7c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.880234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1033/2089] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:19.884602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:19.895740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac92fc-ffc3-4fdd-8f9d-cd90d4f189cd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:19.902682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:19.905440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.905973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.906440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] PATH_INFO: `/v3/projects/adf595e0221945ff806083a77018c3c8/users/3fef10b85e3a469295ca06200f663131/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.924442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf595e0221945ff806083a77018c3c8, user_id=3fef10b85e3a469295ca06200f663131, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:19.927305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:19.942894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1057/2090] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:19 2022] PUT /identity/v3/projects/adf595e0221945ff806083a77018c3c8/users/3fef10b85e3a469295ca06200f663131/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:19.953842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:19.954059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:19.954335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:19.990170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] MFA Rules not processed for user `3fef10b85e3a469295ca06200f663131`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:19.991738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:20.061674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1034/2091] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:20.066889 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.129163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490cd6a-83bc-4c6f-9631-94eb94b8537e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.134154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.134814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.135097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.135374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.136059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.138790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.170125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1058/2092] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:20.174532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.186469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5eefb0-2258-4989-8490-fae729605d75 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.246205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.247417 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.247695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.247969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.248667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.250623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.272156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1035/2093] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:20 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:20.278410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.310700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154a4ff-8e0e-475d-a36d-27bba37a925e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.322686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.323368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.323651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.324002 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.324754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.326517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.340199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1059/2094] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:20.341524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.352020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5393ec-8a7b-4f22-b59c-32884273f893 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.361697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.362072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.362511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.362918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.363757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.368696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a855c99-5104-4770-aba6-2f4bc19e7ac2 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.388304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1036/2095] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:20.392060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.402084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc69b0-62fe-4959-9152-b038781a15d4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.408070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.408968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.409363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.409639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] PATH_INFO: `/v3/projects/81141cced2a448cea69fa3e96ce37802/users/bd69a00d0bc1488cb5b2a9f3a7a6f2e3/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.431011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81141cced2a448cea69fa3e96ce37802, user_id=bd69a00d0bc1488cb5b2a9f3a7a6f2e3, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.434019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.469465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1060/2096] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:20 2022] PUT /identity/v3/projects/81141cced2a448cea69fa3e96ce37802/users/bd69a00d0bc1488cb5b2a9f3a7a6f2e3/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:20.470545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.470842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.471696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.501772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] MFA Rules not processed for user `bd69a00d0bc1488cb5b2a9f3a7a6f2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:20.503018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:20.579262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1037/2097] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:20.580795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.658235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a81c43-9e0f-4082-ac25-68af0f765ae2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.666683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.667428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.667835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.668111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.669398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.673366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.703031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1061/2098] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:20 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:20.707338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.725845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a2e47-599d-419c-bf95-330b32eccba3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.798957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.799917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.800282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.800789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.804902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.807212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.832299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1038/2099] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:20 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:20.837570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.853113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0913-a256-48d6-97ed-6f4e7539e871 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.862354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.863121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.863479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.863831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.864949 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.866624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.878319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1062/2100] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:20.882319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.895510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9dca3-d9b7-4ead-8f71-1408055b20f3 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:20.902193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:20.906108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:20.906390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:20.906668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] PATH_INFO: `/v3/projects/bbfa0ace6ece4e73822a33545e682313/users/a9626df7f0ae4ef1b1e66061e702fcfc/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:20.924156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfa0ace6ece4e73822a33545e682313, user_id=a9626df7f0ae4ef1b1e66061e702fcfc, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:20.927010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:20.940657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1039/2101] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:20 2022] PUT /identity/v3/projects/bbfa0ace6ece4e73822a33545e682313/users/a9626df7f0ae4ef1b1e66061e702fcfc/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:20.944729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:20.955806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23583e07-ab56-4974-bb81-0d5cc05bf39d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:21.029148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:21.029875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.030160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.030435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.031198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:21.032798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946290e-77af-4998-a545-049ea77cfb77 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:21.043308 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1063/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:21.047472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:21.061643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea052-76b5-4a0c-a187-c5819f0c28c2 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:21.069035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:21.069970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.070279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.070552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] PATH_INFO: `/v3/projects/bbfa0ace6ece4e73822a33545e682313/users/a9626df7f0ae4ef1b1e66061e702fcfc/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.072556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfa0ace6ece4e73822a33545e682313, user_id=a9626df7f0ae4ef1b1e66061e702fcfc, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:21.076361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:21.088218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1040/2103] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:21 2022] PUT /identity/v3/projects/bbfa0ace6ece4e73822a33545e682313/users/a9626df7f0ae4ef1b1e66061e702fcfc/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:21.098525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.098853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.099078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.132271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] MFA Rules not processed for user `a9626df7f0ae4ef1b1e66061e702fcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:21.135693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:21.208742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1064/2104] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:21.218284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:21.219961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:21.276784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a135-bf26-4677-a1b9-2e748f2a3bb7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:21.281818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:21.281818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.281818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.282132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.343337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:21.344814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bbf3b-fcfd-4e51-8746-9b49ded1ae7f service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:21.357258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1041/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:21.582683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:21.584620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:21.673223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8a1f4-9156-4480-87f7-d4663d5a5fbf None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:21.677927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:21.678848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.679136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.679410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] PATH_INFO: `/v3/users/653c3b221e394f8ab4ea6614f074e025` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.680666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=653c3b221e394f8ab4ea6614f074e025)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:21.682697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:21.750665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653c3b221e394f8ab4ea6614f074e025'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:21.757843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653c3b221e394f8ab4ea6614f074e025'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:21.767414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653c3b221e394f8ab4ea6614f074e025'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:21.769131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653c3b221e394f8ab4ea6614f074e025'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:21.782467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653c3b221e394f8ab4ea6614f074e025'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:21.788460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1065/2106] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:21 2022] DELETE /identity/v3/users/653c3b221e394f8ab4ea6614f074e025 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:21.793078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.793642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.794441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.811754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:21.813194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:21.875560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1042/2107] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:21.886457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:21.888389 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:21.943818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee43b08-2f3c-44d4-aee8-d65da9cb1ae5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:21.947619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:21.948258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:21.948541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:21.948814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:21.959141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:21.960635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39940d5b-aa7f-43ce-8edf-b3c52ea3257e service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:21.971157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1066/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:22.234791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.236238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:22.249172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9c69-a571-4595-aed4-7be634cb68d7 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.254111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.254783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.255062 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.255338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] PATH_INFO: `/v3/projects/08e3ba9cd15d4f46a0c1b52f7eefbafa` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.256559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e3ba9cd15d4f46a0c1b52f7eefbafa)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.258540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.308242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e3ba9cd15d4f46a0c1b52f7eefbafa', 'request_id': 'req-9e8f762d-d01d-4965-b0ce-4ff65e001abc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:22.315117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e3ba9cd15d4f46a0c1b52f7eefbafa', 'request_id': 'req-9e8f762d-d01d-4965-b0ce-4ff65e001abc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:22.322603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e3ba9cd15d4f46a0c1b52f7eefbafa', 'request_id': 'req-9e8f762d-d01d-4965-b0ce-4ff65e001abc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:22.334616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] The token cache is being invalidate because project 08e3ba9cd15d4f46a0c1b52f7eefbafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:22.335056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:22.335832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9e8f762d-d01d-4965-b0ce-4ff65e001abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:22.337698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1043/2109] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:22 2022] DELETE /identity/v3/projects/08e3ba9cd15d4f46a0c1b52f7eefbafa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:22.342444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.342847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.343271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.362364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:22.363647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:22.423411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1067/2110] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:22.432731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.433096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.433348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.452395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:22.453640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:22.461649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1044/2111] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:22.465909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.475415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55552786-a69a-4646-9193-43cffb6ef0b3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.479948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.480590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.480876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.481180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.481936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:22.482243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.483841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.494986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1068/2112] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:22.499702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.508832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee488b92-1de2-4617-ae47-1cffdeb580a3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.514435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.515085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.515371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.515674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.516354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.518333 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.547908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1045/2113] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:22.549105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.558891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ec604-00c8-426a-bfdc-4ed2a2d33632 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.614346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.614921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.615204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.615482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.616170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.618134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.641154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1069/2114] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:22.642431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.652424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69be1-0e56-42f7-96f8-f4b34cf6b14f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.657041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.657728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.658040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.658314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.659067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.660695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.675672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1046/2115] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:22.677115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.687675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef13d-e2fc-4062-9588-a8736aad31a9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.692507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.693167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.693492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.693772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.694501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.696134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddde13-dcaa-4428-a2c4-03bd9fae9ab1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.706641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1070/2116] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:22.710622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.721258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504de51a-54a7-4e17-a81a-c73e1b1d6ac5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.726389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.727266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.727550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.727843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] PATH_INFO: `/v3/projects/2d9c7253d1d84b10ad108a9dfa8a0387/users/980ad58fe8cd48268998f144494f354e/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.742792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c7253d1d84b10ad108a9dfa8a0387, user_id=980ad58fe8cd48268998f144494f354e, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.745591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.772206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1047/2117] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:22 2022] PUT /identity/v3/projects/2d9c7253d1d84b10ad108a9dfa8a0387/users/980ad58fe8cd48268998f144494f354e/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:22.774295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.774591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.774898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.805027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] MFA Rules not processed for user `980ad58fe8cd48268998f144494f354e`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:22.806640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:22.874492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1071/2118] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:22.878986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.929819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.931214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:22.948900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bf551-f62e-4e0e-a2d8-7306af1a4687 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:22.958174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:22.958839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:22.959142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:22.959435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:22.960761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:22.962749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:22.992379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1048/2119] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:22.997151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:22.997774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56231ac-247c-4a90-9c14-54a697785697 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.045863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.046506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.046812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.047084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.048868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:23.060523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b957df-ef50-4f62-af5d-19ae68409a05 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.065140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.065832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.066131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.066409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.067088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.069002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.089124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1049/2120] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:22 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:23.093020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.102264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52520cd-2db0-4838-aace-1923ecc9de99 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.107403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.107968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.108247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.108625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.109000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.109438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.109929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.111679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.118348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1072/2121] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:23.125856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1050/2122] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:23.127155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.138212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c04df8-f15f-4289-a0aa-8da447470f83 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.142834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.143721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.144046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.144341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] PATH_INFO: `/v3/projects/00e0d6ec73a64aeda5d63d6de772506f/users/c6acd4205040478596746ec9cc1ef5ce/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.160807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e0d6ec73a64aeda5d63d6de772506f, user_id=c6acd4205040478596746ec9cc1ef5ce, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.163715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.175862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1073/2123] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:23 2022] PUT /identity/v3/projects/00e0d6ec73a64aeda5d63d6de772506f/users/c6acd4205040478596746ec9cc1ef5ce/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:23.180002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.192488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb14a-9b3f-4a38-bd44-c2b5219307de admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.267086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.267797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.268083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.268357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.269072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.270721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7089645-f04a-4506-b990-f1fa1be36873 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.280317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1051/2124] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:23.284525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.294742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584203b-adb4-4b1c-9039-8f15ee7837d5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.299502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.300457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.301102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.301102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] PATH_INFO: `/v3/projects/00e0d6ec73a64aeda5d63d6de772506f/users/c6acd4205040478596746ec9cc1ef5ce/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.303189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e0d6ec73a64aeda5d63d6de772506f, user_id=c6acd4205040478596746ec9cc1ef5ce, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.305961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.318103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1074/2125] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:23 2022] PUT /identity/v3/projects/00e0d6ec73a64aeda5d63d6de772506f/users/c6acd4205040478596746ec9cc1ef5ce/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:23.331088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.331380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.331661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.357441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] MFA Rules not processed for user `c6acd4205040478596746ec9cc1ef5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:23.358725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:23.433279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1052/2126] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:23.445436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.447838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:23.515208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8536d3-2967-4412-a8b4-673d8ab8a4d8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.519702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.520356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.520814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.521092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.538354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.539817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.550783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1075/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:23.656707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.730254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.730699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857b67-b593-4d01-9de3-9dfa72428d44 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.736173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.737074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.737391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.737693 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] PATH_INFO: `/v3/users/980ad58fe8cd48268998f144494f354e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.738964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980ad58fe8cd48268998f144494f354e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.741337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.745551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb2bd-7195-4f97-9500-aaeb0d92996e service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:23.751634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:23.752312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.753229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.753229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.755423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:23.807578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980ad58fe8cd48268998f144494f354e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:23.819155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980ad58fe8cd48268998f144494f354e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:23.829123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980ad58fe8cd48268998f144494f354e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:23.829981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980ad58fe8cd48268998f144494f354e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:23.830596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bbcc501-2f38-41df-aa9c-b955d5e42023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980ad58fe8cd48268998f144494f354e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:23.865612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:23.865612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:23.866635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1053/2128] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:23 2022] DELETE /identity/v3/users/980ad58fe8cd48268998f144494f354e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:23.868235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:23.868669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:23.868953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:23.880397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1076/2129] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:23.887619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:23.888841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:23.957089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1054/2130] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:23.971334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:23.972964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:24.036745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf7785-7954-42a0-aff1-a3fe1c0da3e8 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:24.101061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:24.102519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:24.103568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:24.103993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:24.116218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:24.117718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:24.128804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1077/2131] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:24.678233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:24.679740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:24.696979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983687a-cb2b-414f-8bf5-5393e7cdcee9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:24.702676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:24.703594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:24.703773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:24.704122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] PATH_INFO: `/v3/projects/2d9c7253d1d84b10ad108a9dfa8a0387` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:24.705215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c7253d1d84b10ad108a9dfa8a0387)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:24.707133 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:24.751492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c7253d1d84b10ad108a9dfa8a0387', 'request_id': 'req-f0168303-e015-4fe7-97d6-f6361060dd58'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.756620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c7253d1d84b10ad108a9dfa8a0387', 'request_id': 'req-f0168303-e015-4fe7-97d6-f6361060dd58'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.763642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c7253d1d84b10ad108a9dfa8a0387', 'request_id': 'req-f0168303-e015-4fe7-97d6-f6361060dd58'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.774641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] The token cache is being invalidate because project 2d9c7253d1d84b10ad108a9dfa8a0387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:24.774933 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.775574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.777095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1055/2132] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:24 2022] DELETE /identity/v3/projects/2d9c7253d1d84b10ad108a9dfa8a0387 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:24.781548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:24.791337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1eb7d-8bb3-4bbf-bd58-79da22db99bd service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:24.847655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:24.848525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:24.848808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:24.849085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] PATH_INFO: `/v3/users/c6acd4205040478596746ec9cc1ef5ce` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:24.850356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6acd4205040478596746ec9cc1ef5ce)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:24.852298 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:24.895781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6acd4205040478596746ec9cc1ef5ce'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.902269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6acd4205040478596746ec9cc1ef5ce'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.909604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6acd4205040478596746ec9cc1ef5ce'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.910221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6acd4205040478596746ec9cc1ef5ce'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.922260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6acd4205040478596746ec9cc1ef5ce'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:24.928814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1078/2133] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:24 2022] DELETE /identity/v3/users/c6acd4205040478596746ec9cc1ef5ce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:25.186915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.188784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.204455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0168303-e015-4fe7-97d6-f6361060dd58 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.236242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.238778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.315790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.317035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.317506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.317883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] PATH_INFO: `/v3/users/c2cdda0d9cff44238f04ad13ae945aa8` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.319206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cdda0d9cff44238f04ad13ae945aa8)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.321281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.321999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ff33f-78bd-461d-b768-a6681ee27026 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.327580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.328676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.329101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.329564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] PATH_INFO: `/v3/projects/00e0d6ec73a64aeda5d63d6de772506f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.331243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e0d6ec73a64aeda5d63d6de772506f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.333564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.378267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cdda0d9cff44238f04ad13ae945aa8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.383678 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e0d6ec73a64aeda5d63d6de772506f', 'request_id': 'req-2c4885b0-ef95-4631-a803-04766e0aef7c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.387001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cdda0d9cff44238f04ad13ae945aa8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.391622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e0d6ec73a64aeda5d63d6de772506f', 'request_id': 'req-2c4885b0-ef95-4631-a803-04766e0aef7c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.394973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cdda0d9cff44238f04ad13ae945aa8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.395651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cdda0d9cff44238f04ad13ae945aa8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.396250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-63562c6e-7702-4ff1-a349-068d3c795020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cdda0d9cff44238f04ad13ae945aa8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.398958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e0d6ec73a64aeda5d63d6de772506f', 'request_id': 'req-2c4885b0-ef95-4631-a803-04766e0aef7c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.413163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] The token cache is being invalidate because project 00e0d6ec73a64aeda5d63d6de772506f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:25.413491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.414119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2c4885b0-ef95-4631-a803-04766e0aef7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:25.415838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1079/2134] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:25 2022] DELETE /identity/v3/projects/00e0d6ec73a64aeda5d63d6de772506f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:25.416066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1056/2135] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:25 2022] DELETE /identity/v3/users/c2cdda0d9cff44238f04ad13ae945aa8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:25.421116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df01-95ff-4f25-9b24-cae1b294f4f8 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.421594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df01-95ff-4f25-9b24-cae1b294f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.421863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271df01-95ff-4f25-9b24-cae1b294f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.422046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.422395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.422673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.440328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:25.441933 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0271df01-95ff-4f25-9b24-cae1b294f4f8 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:25.442175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.443114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0271df01-95ff-4f25-9b24-cae1b294f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.502969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1080/2136] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:25.505856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1057/2137] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:25.510364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.510849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.511456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.515545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.516926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.530828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:25.532022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.539899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1081/2138] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:25.544558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.553163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8af2c9-462d-4ba5-adb0-1abcf866caf6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.558364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.558997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.559306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.559580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.560293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:25.560599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.562231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.573576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bc87-e7ad-4e3e-8df1-fc4df839de9c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.573969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1082/2139] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:25.577798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.578359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.578477 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.578709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.578983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.588025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.588152 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a55eb-972b-454a-89f0-aa9caa78c7bd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.589487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.593296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.593923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.594208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.594487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.595162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.597050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.599446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1058/2140] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:25.626236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1083/2141] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:25.630622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.640874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000abd8-7b8c-4ed6-aecc-7ef312a543a6 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.706061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.706744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.707044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.707329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.708049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.710109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.738678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1059/2142] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:25.740487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.751706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb9188-543e-4486-b523-992e0b2e2f9f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.756458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.757213 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.757573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.757938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.758753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.760402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.776723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1084/2143] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:25.778308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.790242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852cabd-66c7-4b3e-ae86-94978b0ffee0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.803004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.803004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.803004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.803004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.803634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.806394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0efa5-d92d-40ba-8878-a94d499af12f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.827395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1060/2144] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:25.829740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.841044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81896-b352-4843-9cb6-75505d7cb773 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.846329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.847522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.848481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.848601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] PATH_INFO: `/v3/projects/f201263bc6384f149b71edad0395914d/users/7735bd34581140b38978636e76e3b131/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.871914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f201263bc6384f149b71edad0395914d, user_id=7735bd34581140b38978636e76e3b131, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:25.883217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:25.897484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1085/2145] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:25 2022] PUT /identity/v3/projects/f201263bc6384f149b71edad0395914d/users/7735bd34581140b38978636e76e3b131/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:25.908457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.908818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.909095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.924729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:25.926616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.938360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] MFA Rules not processed for user `7735bd34581140b38978636e76e3b131`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:25.939577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:25.991071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fba6c-1a82-4180-8d78-5c40c2e6010d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:25.995896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:25.997408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:25.998186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:25.998414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] PATH_INFO: `/v3/projects/11dac266787e4040ae4f5ebc56922c58` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:25.999866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11dac266787e4040ae4f5ebc56922c58)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.002226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.003789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1061/2146] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:26.008444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.019400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159aa97-a97f-4947-a02c-13639a832928 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.023982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.024620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.024903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.025180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.025886 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.027848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.049492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11dac266787e4040ae4f5ebc56922c58', 'request_id': 'req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:26.052856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1062/2147] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:26.056225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11dac266787e4040ae4f5ebc56922c58', 'request_id': 'req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:26.056716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.062207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11dac266787e4040ae4f5ebc56922c58', 'request_id': 'req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:26.075454 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] The token cache is being invalidate because project 11dac266787e4040ae4f5ebc56922c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:26.075751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:26.076394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7872e8b8-beb9-4fd3-9577-e104b13b8d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:26.077980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1086/2148] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:25 2022] DELETE /identity/v3/projects/11dac266787e4040ae4f5ebc56922c58 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:26.082514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a775d-8f11-4c3c-97cf-bdb5e53005cc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.082804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a775d-8f11-4c3c-97cf-bdb5e53005cc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.083085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a775d-8f11-4c3c-97cf-bdb5e53005cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.100460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ca2a775d-8f11-4c3c-97cf-bdb5e53005cc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:26.101698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ca2a775d-8f11-4c3c-97cf-bdb5e53005cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.120623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fbe23-2009-4f8b-ae14-ff85d57c58a0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.126550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.127220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.127506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.127785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.128501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.130473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.153078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1063/2149] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:26.154179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.155843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.161123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1087/2150] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:26.168237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95ef71-a823-47be-bcd4-5e60d17dee24 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.169629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.169924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.170205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.172240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.172896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.173183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.173486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.174206 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.175803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.188998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1064/2151] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:26.189622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:26.189874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.190005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.197826 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1088/2152] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:26.199202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ac24-7cf6-46d6-aa21-c5747c4bb0ef admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.202450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.204318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.205045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.205365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.205641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.206341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.207899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.211328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1f9e-a54e-4ece-ba5a-068f0877ce3d None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.216077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.216712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.217000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.217309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.218231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:26.218358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1065/2153] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:26.218547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.220228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.222344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.231563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1e5e4-a985-4bc2-8667-847f4d5d8a41 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.235735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1089/2154] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:26.236046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.236672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.237106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.237184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.237452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] PATH_INFO: `/v3/projects/85dfb75e1b024b0cb4a38aa33a96d0e1/users/918c3effe4d5462ca0230c959a87b000/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.246198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c844f4-ac1f-461b-84ed-4b9602661e17 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.251407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.252044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.252325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.252463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dfb75e1b024b0cb4a38aa33a96d0e1, user_id=918c3effe4d5462ca0230c959a87b000, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.252642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.253301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.255207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d255e-0e55-429b-aa86-a65125070a35 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.255314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.268443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1066/2155] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:26 2022] PUT /identity/v3/projects/85dfb75e1b024b0cb4a38aa33a96d0e1/users/918c3effe4d5462ca0230c959a87b000/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:26.280574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.280860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.281136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.283162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1090/2156] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:26.287230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.308616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] MFA Rules not processed for user `918c3effe4d5462ca0230c959a87b000`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:26.310352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.355506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bf9fe-472d-48b7-8d71-f13aa2d334d6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.363761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.364442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.364914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.365796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.366506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.370554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.378132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1067/2157] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:26.382790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.395433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f896868-0384-44b4-8c2e-ba45ece566e9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.400115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1091/2158] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:26.403653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.404402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.404768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.405298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.406200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.408371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.411084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.425098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdb462-a970-46bb-8c65-1924cd14a3d7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.431373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.432316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.432736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.433124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.434151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.436805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.452314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1068/2159] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:26.455746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.462391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1092/2160] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:26.466650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.480362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9489d-0363-4c0d-a617-67d9190d65cf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.547643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650be77-2f88-4f4c-8200-540fc9caa29b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.554054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.554920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.555207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.555520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.556497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.558148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.559678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.560343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.560628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.560902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.561635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.563571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.573254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1093/2161] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:26.575548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.588786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a3c4a-b3e7-4a0a-990b-5271df6668cb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.592598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1069/2162] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:26.594008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.595708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.596971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.597430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.597809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] PATH_INFO: `/v3/projects/29588f8bb47942dba75e8f7b774a20bf/users/f0a8dc55c79d46bc8edb149020821a86/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.606243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26db78-6609-403a-a991-c044ad8477e5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.613763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.614441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.614723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.614995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.615861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.617632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.622229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29588f8bb47942dba75e8f7b774a20bf, user_id=f0a8dc55c79d46bc8edb149020821a86, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.625142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636be9bf-8193-4a36-a2c3-0f0160036928 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.632927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1070/2163] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:26.640489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.652488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1094/2164] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:26 2022] PUT /identity/v3/projects/29588f8bb47942dba75e8f7b774a20bf/users/f0a8dc55c79d46bc8edb149020821a86/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:26.660070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.660438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.660802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.671571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4577ab-0ab8-4bea-9964-e8f40ae825c0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.697667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] MFA Rules not processed for user `f0a8dc55c79d46bc8edb149020821a86`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:26.698525 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.764591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.767011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.767418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.767799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] PATH_INFO: `/v3/projects/3a0b57b515744f44a29410560b83391e/users/f00c148f945d4ab6a03ff833cdfbd9de/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.788411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b57b515744f44a29410560b83391e, user_id=f00c148f945d4ab6a03ff833cdfbd9de, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.792863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.818216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1071/2165] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:26 2022] PUT /identity/v3/projects/3a0b57b515744f44a29410560b83391e/users/f00c148f945d4ab6a03ff833cdfbd9de/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:26.822447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.844309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1095/2166] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:26.856218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.857726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:26.921780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fa7e5-414d-4a66-a334-77e719ad4368 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.924133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc0fe-ce53-4b31-bd33-5ada624cb931 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:26.936638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.940291 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.941999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.943746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:26.945740 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:26.950481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:26.975621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1072/2167] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:26.979567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:26.992993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:26.994117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:26.995001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:26.995520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.005498 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7ba99-fdf5-404e-a630-3a23b978c383 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:27.020658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:27.021589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:27.022562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:27.022850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] PATH_INFO: `/v3/projects/3a0b57b515744f44a29410560b83391e/users/f00c148f945d4ab6a03ff833cdfbd9de/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.027635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b57b515744f44a29410560b83391e, user_id=f00c148f945d4ab6a03ff833cdfbd9de, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:27.030344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b28105-6599-41f7-862d-40ead8d9123f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:27.051569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1073/2168] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:26 2022] PUT /identity/v3/projects/3a0b57b515744f44a29410560b83391e/users/f00c148f945d4ab6a03ff833cdfbd9de/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:27.062414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:27.062708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:27.063070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.110768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] MFA Rules not processed for user `f00c148f945d4ab6a03ff833cdfbd9de`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:27.112234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:27.162731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:27.164260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:27.201288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1096/2169] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:27.229826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1074/2170] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:27.251211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:27.259868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e75c40-617a-4f86-85d5-e555af3077bf service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:27.341930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:27.342598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:27.342894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:27.343258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.353319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:27.354779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:27.366112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1097/2171] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:27.410851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:27.421392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab10148-dff5-4848-becd-cadcd305df67 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:27.425404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:27.426165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:27.426556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:27.426935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.428824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:27.491774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:27.494316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25cd67-ab7c-43fc-b8a7-feef2d01f3f9 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:27.504579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1075/2172] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:27.905604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:27.907301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:27.970423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405cc6a-7ebb-406e-8615-32d582d84bc0 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:27.974911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:27.975772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:27.976049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:27.976321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] PATH_INFO: `/v3/users/3fef10b85e3a469295ca06200f663131` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:27.977515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fef10b85e3a469295ca06200f663131)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:27.979435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:28.023716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fef10b85e3a469295ca06200f663131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.030886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fef10b85e3a469295ca06200f663131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.037274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fef10b85e3a469295ca06200f663131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.037971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fef10b85e3a469295ca06200f663131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.049884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fef10b85e3a469295ca06200f663131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.055603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1098/2173] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:27 2022] DELETE /identity/v3/users/3fef10b85e3a469295ca06200f663131 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:28.060762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:28.061050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:28.061372 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:28.077649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:28.078827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:28.134125 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1076/2174] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:28.144535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:28.145992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:28.201995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795d3d-041b-47d6-9175-31180b3eef39 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:28.205616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:28.206257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:28.206539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:28.206811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:28.216888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:28.218410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:28.229477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1099/2175] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:28.484207 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:28.485679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:28.499332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63673-89c0-4268-9ded-0849065f7a9b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:28.503969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:28.504829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:28.505110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:28.505407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] PATH_INFO: `/v3/projects/adf595e0221945ff806083a77018c3c8` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:28.506582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf595e0221945ff806083a77018c3c8)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:28.509177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:28.553840 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf595e0221945ff806083a77018c3c8', 'request_id': 'req-b2fa7845-4edc-4df2-95b4-977188433b87'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.559552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf595e0221945ff806083a77018c3c8', 'request_id': 'req-b2fa7845-4edc-4df2-95b4-977188433b87'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.566621 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf595e0221945ff806083a77018c3c8', 'request_id': 'req-b2fa7845-4edc-4df2-95b4-977188433b87'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.578071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] The token cache is being invalidate because project adf595e0221945ff806083a77018c3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:28.578296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.578957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.580474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1077/2176] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:28 2022] DELETE /identity/v3/projects/adf595e0221945ff806083a77018c3c8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:28.584395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:28.593898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb71be-dcd8-4521-9199-e8a9e93c71a4 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:28.649170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:28.650067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:28.650346 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:28.650612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] PATH_INFO: `/v3/users/bd69a00d0bc1488cb5b2a9f3a7a6f2e3` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:28.651779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd69a00d0bc1488cb5b2a9f3a7a6f2e3)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:28.653749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:28.708387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd69a00d0bc1488cb5b2a9f3a7a6f2e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.716119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd69a00d0bc1488cb5b2a9f3a7a6f2e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.725371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd69a00d0bc1488cb5b2a9f3a7a6f2e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.726404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd69a00d0bc1488cb5b2a9f3a7a6f2e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.742866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd69a00d0bc1488cb5b2a9f3a7a6f2e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:28.751333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1100/2177] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:28 2022] DELETE /identity/v3/users/bd69a00d0bc1488cb5b2a9f3a7a6f2e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:29.035684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.037197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:29.051885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7845-4edc-4df2-95b4-977188433b87 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:29.106408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:29.107826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.108108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.108382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] PATH_INFO: `/v3/projects/81141cced2a448cea69fa3e96ce37802` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.109627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81141cced2a448cea69fa3e96ce37802)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:29.111532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:29.154686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81141cced2a448cea69fa3e96ce37802', 'request_id': 'req-af047700-6a19-4796-930e-379375a4f414'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.159940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81141cced2a448cea69fa3e96ce37802', 'request_id': 'req-af047700-6a19-4796-930e-379375a4f414'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.166551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81141cced2a448cea69fa3e96ce37802', 'request_id': 'req-af047700-6a19-4796-930e-379375a4f414'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.177395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] The token cache is being invalidate because project 81141cced2a448cea69fa3e96ce37802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:29.177677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.178284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.179783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1078/2178] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:29 2022] DELETE /identity/v3/projects/81141cced2a448cea69fa3e96ce37802 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:29.183726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.185235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:29.197542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42c3a0-2b1a-439d-ae3a-a0b54a378877 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:29.251376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:29.252264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.252505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.252778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] PATH_INFO: `/v3/users/a9626df7f0ae4ef1b1e66061e702fcfc` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.253977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9626df7f0ae4ef1b1e66061e702fcfc)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:29.256012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:29.315590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9626df7f0ae4ef1b1e66061e702fcfc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.322515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9626df7f0ae4ef1b1e66061e702fcfc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.331144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9626df7f0ae4ef1b1e66061e702fcfc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.331828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9626df7f0ae4ef1b1e66061e702fcfc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.344769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-46bb03fb-b653-4d6d-b0cf-93781306fcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9626df7f0ae4ef1b1e66061e702fcfc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.350952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1101/2179] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:29 2022] DELETE /identity/v3/users/a9626df7f0ae4ef1b1e66061e702fcfc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:29.605252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.606731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:29.619625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af047700-6a19-4796-930e-379375a4f414 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:29.674226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:29.675081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.675384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.675659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] PATH_INFO: `/v3/projects/bbfa0ace6ece4e73822a33545e682313` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.676818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfa0ace6ece4e73822a33545e682313)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:29.678770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:29.725927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfa0ace6ece4e73822a33545e682313', 'request_id': 'req-a2b9ee11-cd5f-4048-a545-1092aba8572f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.731371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfa0ace6ece4e73822a33545e682313', 'request_id': 'req-a2b9ee11-cd5f-4048-a545-1092aba8572f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.738152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfa0ace6ece4e73822a33545e682313', 'request_id': 'req-a2b9ee11-cd5f-4048-a545-1092aba8572f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.749174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] The token cache is being invalidate because project bbfa0ace6ece4e73822a33545e682313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:29.749486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.750111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a2b9ee11-cd5f-4048-a545-1092aba8572f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:29.751619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1079/2180] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:29 2022] DELETE /identity/v3/projects/bbfa0ace6ece4e73822a33545e682313 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:29.756616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.757070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.757179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.777430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:29.778632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:29.843653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1102/2181] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:29.852110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.852392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.852664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.870401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:29.871816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:29.880038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1080/2182] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:29.884156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.894945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eeaf9-bcd4-489b-a9ed-e9dbfba9c5cb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:29.899893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:29.900490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.900741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.901017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.901812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:29.902103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:29.903719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:29.916052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1103/2183] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:29.920227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.929860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5e99-6a1f-4581-9821-ffabc1eba811 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:29.934482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:29.935143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:29.935925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:29.936340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:29.937156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:29.939052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:29.974014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1081/2184] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:29 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:29.978156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:29.988726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac91b7-75ac-43e1-9bd7-74229feacc6f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:30.045174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:30.045907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.046132 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.046523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.047147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:30.049154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:30.068815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1104/2185] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:29 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:30.072908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:30.083308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44dc58-2fc0-4721-970c-90e67a903fa1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:30.087918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:30.088568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.088851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.089130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.089884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:30.091520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:30.101642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1082/2186] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:30.105315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:30.115507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c6a5d-92c9-4303-9303-348bee2743e9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:30.120101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:30.120796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.121022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.121334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.122050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:30.124196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdcb2d-91d0-4336-baa8-d8c2b148dd2b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:30.133717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1105/2187] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:30.137932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:30.150928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e19c2-06f7-48e6-9103-eb54abeb36da admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:30.157524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:30.158841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.159260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.159674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] PATH_INFO: `/v3/projects/7e62e10833584bf2aa6bed03b41ba89a/users/11db1721d8a644dba09708e4feb4edd0/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.182912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e62e10833584bf2aa6bed03b41ba89a, user_id=11db1721d8a644dba09708e4feb4edd0, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:30.187034 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:30.200243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1083/2188] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:30 2022] PUT /identity/v3/projects/7e62e10833584bf2aa6bed03b41ba89a/users/11db1721d8a644dba09708e4feb4edd0/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:30.205479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97341-7b7e-49a0-95cc-e242a6bffa07 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.205769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97341-7b7e-49a0-95cc-e242a6bffa07 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.206048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97341-7b7e-49a0-95cc-e242a6bffa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.223097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c6c97341-7b7e-49a0-95cc-e242a6bffa07 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:30.224286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c6c97341-7b7e-49a0-95cc-e242a6bffa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:30.279474 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1106/2189] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:30.288810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:30.290554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:30.345544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08fead-2ed3-4323-a729-0abc0283df0c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:30.349341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:30.349986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:30.350264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:30.350537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:30.360644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:30.362233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:30.372242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1084/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:31.040012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2641c-5f76-44d3-83a1-230362de64a1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:31.041071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2641c-5f76-44d3-83a1-230362de64a1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:31.042013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2641c-5f76-44d3-83a1-230362de64a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:31.076534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-22a2641c-5f76-44d3-83a1-230362de64a1 None None] MFA Rules not processed for user `11db1721d8a644dba09708e4feb4edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:31.077822 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-22a2641c-5f76-44d3-83a1-230362de64a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:31.151224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1107/2191] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:31.162130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:31.163701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:31.233803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224403-bcbf-457a-b955-03b29c4f3f7b service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:31.237474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:31.238120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:31.238403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:31.238679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:31.246729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:31.248203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e04ee-4f64-46dc-8d2b-dd5d7abd675b service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:31.256722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1085/2192] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:31.533288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:31.533649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:31.533932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:31.551958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] MFA Rules not processed for user `a5876d477f6d45ddb1f1f68a05c06abd`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:31.553139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:31.607789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1108/2193] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:32.632101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b295-e2c9-4a7a-9b04-5cf71fa735bf None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:32.632603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b295-e2c9-4a7a-9b04-5cf71fa735bf None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:32.632695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b295-e2c9-4a7a-9b04-5cf71fa735bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:32.651079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ac96b295-e2c9-4a7a-9b04-5cf71fa735bf None None] MFA Rules not processed for user `11db1721d8a644dba09708e4feb4edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:32.652421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ac96b295-e2c9-4a7a-9b04-5cf71fa735bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:32.661387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1086/2194] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:36.824321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:36.825814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:36.841240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f6fc-90fb-4229-afca-7c281629f64e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:36.846853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:36.847792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:36.848077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:36.848352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] PATH_INFO: `/v3/users/7735bd34581140b38978636e76e3b131` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:36.849658 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7735bd34581140b38978636e76e3b131)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:36.851908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:36.897061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7735bd34581140b38978636e76e3b131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:36.903953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7735bd34581140b38978636e76e3b131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:36.911772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7735bd34581140b38978636e76e3b131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:36.912373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7735bd34581140b38978636e76e3b131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:36.923616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7735bd34581140b38978636e76e3b131'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:36.929568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1109/2195] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:36 2022] DELETE /identity/v3/users/7735bd34581140b38978636e76e3b131 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:36.934324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:36.934800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:36.934892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:36.952503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:36.954247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:37.012855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1087/2196] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:37.022969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:37.024452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:37.080201 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b430-c37a-47eb-9ebb-0e288a50c719 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:37.083919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:37.084559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:37.085578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:37.085876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:37.096110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:37.097579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:37.106929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1110/2197] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:37.396678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:37.398113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:37.410304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cee69a-ebe4-4683-adc3-35593f86b318 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:37.415004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:37.415891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:37.416331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:37.416795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] PATH_INFO: `/v3/projects/f201263bc6384f149b71edad0395914d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:37.418010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f201263bc6384f149b71edad0395914d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:37.419926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:37.464997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f201263bc6384f149b71edad0395914d', 'request_id': 'req-43c30749-db55-4a68-adfe-c3751779e0a4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.470855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f201263bc6384f149b71edad0395914d', 'request_id': 'req-43c30749-db55-4a68-adfe-c3751779e0a4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.477694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f201263bc6384f149b71edad0395914d', 'request_id': 'req-43c30749-db55-4a68-adfe-c3751779e0a4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.489953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] The token cache is being invalidate because project f201263bc6384f149b71edad0395914d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:37.490238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.491055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.492750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1088/2198] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:37 2022] DELETE /identity/v3/projects/f201263bc6384f149b71edad0395914d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:37.497044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:37.507235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf67d-1690-4371-8f50-2904775c405c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:37.566540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:37.567460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:37.567744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:37.568018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] PATH_INFO: `/v3/users/918c3effe4d5462ca0230c959a87b000` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:37.569320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918c3effe4d5462ca0230c959a87b000)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:37.571191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:37.630604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918c3effe4d5462ca0230c959a87b000'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.637912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918c3effe4d5462ca0230c959a87b000'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.647468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918c3effe4d5462ca0230c959a87b000'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.648210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918c3effe4d5462ca0230c959a87b000'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.663121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918c3effe4d5462ca0230c959a87b000'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:37.670639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1111/2199] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:37 2022] DELETE /identity/v3/users/918c3effe4d5462ca0230c959a87b000 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:37.962842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:37.964312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:37.980647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30749-db55-4a68-adfe-c3751779e0a4 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.038100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.038885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.039166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.039440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] PATH_INFO: `/v3/projects/85dfb75e1b024b0cb4a38aa33a96d0e1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.040605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dfb75e1b024b0cb4a38aa33a96d0e1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.042533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.086059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dfb75e1b024b0cb4a38aa33a96d0e1', 'request_id': 'req-65965722-fae5-4e0b-ba24-0dcebfb33a47'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.091254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dfb75e1b024b0cb4a38aa33a96d0e1', 'request_id': 'req-65965722-fae5-4e0b-ba24-0dcebfb33a47'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.098694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dfb75e1b024b0cb4a38aa33a96d0e1', 'request_id': 'req-65965722-fae5-4e0b-ba24-0dcebfb33a47'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.109774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] The token cache is being invalidate because project 85dfb75e1b024b0cb4a38aa33a96d0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:38.110061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.110692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.112221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1089/2200] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:37 2022] DELETE /identity/v3/projects/85dfb75e1b024b0cb4a38aa33a96d0e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:38.116151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:38.117563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:38.130165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9b4d2-2a0b-483d-9c66-17eb6b12e0f7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.186118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.186993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.187318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.187593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] PATH_INFO: `/v3/users/f00c148f945d4ab6a03ff833cdfbd9de` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.188783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00c148f945d4ab6a03ff833cdfbd9de)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.190761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.236624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00c148f945d4ab6a03ff833cdfbd9de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.244059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00c148f945d4ab6a03ff833cdfbd9de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.250477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00c148f945d4ab6a03ff833cdfbd9de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.251183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00c148f945d4ab6a03ff833cdfbd9de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.263267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f116c83c-dcb5-4100-8d12-8277de7a2cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00c148f945d4ab6a03ff833cdfbd9de'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.269611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1112/2201] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:38 2022] DELETE /identity/v3/users/f00c148f945d4ab6a03ff833cdfbd9de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:38.533229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:38.534705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:38.547721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65965722-fae5-4e0b-ba24-0dcebfb33a47 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.605008 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.605902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.606190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.606467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] PATH_INFO: `/v3/projects/3a0b57b515744f44a29410560b83391e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.607636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b57b515744f44a29410560b83391e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.609633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.655595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b57b515744f44a29410560b83391e', 'request_id': 'req-89ac5b58-1aec-4181-96c4-311321977c23'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.660980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b57b515744f44a29410560b83391e', 'request_id': 'req-89ac5b58-1aec-4181-96c4-311321977c23'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.668746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b57b515744f44a29410560b83391e', 'request_id': 'req-89ac5b58-1aec-4181-96c4-311321977c23'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.679519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] The token cache is being invalidate because project 3a0b57b515744f44a29410560b83391e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:38.679936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.680408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89ac5b58-1aec-4181-96c4-311321977c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:38.682903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1090/2202] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:38 2022] DELETE /identity/v3/projects/3a0b57b515744f44a29410560b83391e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:38.689136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.689462 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.689783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.708984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:38.710193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:38.768264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1113/2203] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:38.776598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.776890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.777184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.794986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:38.796100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:38.804096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1091/2204] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:38.808365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:38.818781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d864-14ec-4c6a-9bb9-23d6cab4ce26 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.823712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.824367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.824649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.824921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.825680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:38.825985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.827575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.842579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1114/2205] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:38.846969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:38.858480 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527d05e-bba3-4e7e-b859-089f43ba54c6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.863126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.863779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.864279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.864425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.865005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.866961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.896350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1092/2206] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:38.897537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:38.907707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3197-c962-42a1-be38-1e1484f29fb0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:38.962989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:38.963654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:38.963936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:38.964211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:38.964884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:38.966856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:38.988782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1115/2207] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:38 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:38.990009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:39.000983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857da55-78e8-4540-bcb1-4997c75e6759 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:39.005726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:39.006390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:39.006723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:39.007005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:39.007764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:39.009413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:39.019961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1093/2208] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:20:39.024036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:39.033893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d9eb6-091f-46ff-ad53-0927991f1624 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:39.038365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:39.039010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:39.039290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:39.039568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:39.040284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:39.041922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d47c-7fce-4265-9275-95d14db3ac18 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:39.052629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1116/2209] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:39.056451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:39.066745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a1b7-d63a-49e7-bd9b-16019bc27ffa admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:39.071278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:39.072143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:39.072427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:39.072701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] PATH_INFO: `/v3/projects/93badfe81d394b2d99aeb3ae491e4899/users/44b51b1150554da38890780ece3d3a6d/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:39.086966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93badfe81d394b2d99aeb3ae491e4899, user_id=44b51b1150554da38890780ece3d3a6d, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:39.089647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:39.102301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1094/2210] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:39 2022] PUT /identity/v3/projects/93badfe81d394b2d99aeb3ae491e4899/users/44b51b1150554da38890780ece3d3a6d/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:39.114441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:39.114731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:39.115007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:39.140799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] MFA Rules not processed for user `44b51b1150554da38890780ece3d3a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:39.142205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:39.202114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1117/2211] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:39.213900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:39.215578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:39.271652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cba60-38f4-4ba7-9fb2-f8f19a4ff2cb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:39.275318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:39.276085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:39.276366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:39.276639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:39.286332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:39.287748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf43f9-a488-4452-85c3-63f2a34cb259 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:39.297921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1095/2212] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:41.794294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:41.796060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:41.863330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76e415-380c-44e9-9193-8fbf0fe97081 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:41.867892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:41.868755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:41.869040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:41.869352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] PATH_INFO: `/v3/users/f0a8dc55c79d46bc8edb149020821a86` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:41.870551 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a8dc55c79d46bc8edb149020821a86)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:41.872494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:41.919129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a8dc55c79d46bc8edb149020821a86'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:41.925914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a8dc55c79d46bc8edb149020821a86'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:41.933330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a8dc55c79d46bc8edb149020821a86'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:41.934046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a8dc55c79d46bc8edb149020821a86'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:41.946397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a8dc55c79d46bc8edb149020821a86'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:41.952141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1118/2213] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:41 2022] DELETE /identity/v3/users/f0a8dc55c79d46bc8edb149020821a86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:41.956637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:41.957106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:41.957240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:41.974445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:41.975637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:42.034089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1096/2214] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:42.043724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.045190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:42.100717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ce916-756b-40bf-99db-cb659803dd95 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.104390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.105032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.105393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.105676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.114509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.115952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625529-8e56-4969-9aa8-2650821d34dd service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.125221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1119/2215] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:42.445615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.447711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:42.463551 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063eba7-0ecb-44b8-8519-0b225a939d56 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.469132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.470040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.470379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.470663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] PATH_INFO: `/v3/projects/29588f8bb47942dba75e8f7b774a20bf` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.471872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29588f8bb47942dba75e8f7b774a20bf)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.473913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.532245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29588f8bb47942dba75e8f7b774a20bf', 'request_id': 'req-89f60e20-67a0-47e9-a967-ec9f659a1084'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:42.537669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29588f8bb47942dba75e8f7b774a20bf', 'request_id': 'req-89f60e20-67a0-47e9-a967-ec9f659a1084'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:42.545577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29588f8bb47942dba75e8f7b774a20bf', 'request_id': 'req-89f60e20-67a0-47e9-a967-ec9f659a1084'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:42.556690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] The token cache is being invalidate because project 29588f8bb47942dba75e8f7b774a20bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:42.556976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:42.557657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-89f60e20-67a0-47e9-a967-ec9f659a1084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:42.559260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1097/2216] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:42 2022] DELETE /identity/v3/projects/29588f8bb47942dba75e8f7b774a20bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:42.564760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.565078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.565412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.583655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:42.584867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:42.642216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1120/2217] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:42.650096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.650385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.650661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.668142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:42.669365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:42.676993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1098/2218] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:42.680980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.690764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e4c5-d549-4d6b-ac04-77af5225bfc3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.695271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.695914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.696199 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.696479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.697234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:42.697543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.699138 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.710743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1121/2219] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:20:42.714750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.723578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbdd99-32de-469e-bb13-04eb80c09d54 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.728035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.728663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.728940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.729227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.729901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.731805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.757575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1099/2220] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:42 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:42.762086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.771853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d244209-f620-4687-9fbe-75a5e4ea95c3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.828628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.832297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.832297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.832297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.832297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.832635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.852992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1122/2221] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:42 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:42.857625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.868449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccc05c-4790-4f54-b0c9-67606759afb6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.873123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.873838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.874124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.874424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.875759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.877378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.887665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1100/2222] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:42.891570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.901619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde55dd-8134-42e5-abe1-365452acf3e8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.906446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.907103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.907409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.907668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.908396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.910029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905088d5-3369-4a9a-88aa-edfb66e7075f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.919687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1123/2223] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:42.924142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:42.933773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd552-aeed-43cf-af9f-f5c82111cb10 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:42.939227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:42.940154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.940439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.940719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] PATH_INFO: `/v3/projects/dbdf2d71a8ec431a871b6561439a3199/users/2b7f4e19dcdf475bb44bb51597281a43/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.955175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdf2d71a8ec431a871b6561439a3199, user_id=2b7f4e19dcdf475bb44bb51597281a43, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:42.957890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:42.970928 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1101/2224] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:42 2022] PUT /identity/v3/projects/dbdf2d71a8ec431a871b6561439a3199/users/2b7f4e19dcdf475bb44bb51597281a43/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:42.975798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2749065-7312-49f9-90d1-b87a7629c3e2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:42.976094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2749065-7312-49f9-90d1-b87a7629c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:42.976373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2749065-7312-49f9-90d1-b87a7629c3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:42.993947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b2749065-7312-49f9-90d1-b87a7629c3e2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:42.995135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b2749065-7312-49f9-90d1-b87a7629c3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:43.052937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1124/2225] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:43.063123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:43.064818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:43.118488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625b785-4d6b-403c-8828-c9fbdb5f945a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:43.122097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:43.122734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:43.123014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:43.123293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:43.132711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:43.134159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:43.143500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1102/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:48.487719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.488723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.489229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.520897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] MFA Rules not processed for user `2b7f4e19dcdf475bb44bb51597281a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:48.522177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:48.592608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1125/2227] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:48.597779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:48.607445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493878c-180f-40dd-8963-0d46d128d217 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:48.612658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:48.613331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.613615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.613966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.614664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:48.616550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:48.641888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1103/2228] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:48 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:48.645905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:48.659644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0c43-4fe4-4087-8c86-b7942f822776 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:48.720248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:48.720939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.721255 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.721540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.723853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:48.724223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:48.746784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1126/2229] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:48 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:48.750939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:48.764680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8389-45f4-4115-ad27-3680b5d698eb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:48.770122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:48.770810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.771092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.771527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.772223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:48.773924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:48.785841 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1104/2230] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:48.790168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:48.801065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd935d-009c-4397-8b28-c773515569f3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:48.806715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:48.807609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.807897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.808188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] PATH_INFO: `/v3/projects/c5c8dffbd780407dba917abeb6f69aa5/users/5b6086c8605c401986cb65ef7db9a749/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.824670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c8dffbd780407dba917abeb6f69aa5, user_id=5b6086c8605c401986cb65ef7db9a749, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:48.827295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:48.867626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1127/2231] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:48 2022] PUT /identity/v3/projects/c5c8dffbd780407dba917abeb6f69aa5/users/5b6086c8605c401986cb65ef7db9a749/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:48.882932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:48.897014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565373ca-82f1-4261-9f91-af83b03ee2f5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:48.975694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:48.976569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:48.976858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:48.977466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:48.978350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:48.980154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:48.993420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1105/2232] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:48.997701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:49.013992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b031-5ce2-4eac-8905-37cfb9de76ac admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:49.027094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:49.028161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:49.028444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:49.028720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] PATH_INFO: `/v3/projects/c5c8dffbd780407dba917abeb6f69aa5/users/5b6086c8605c401986cb65ef7db9a749/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:49.031421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c8dffbd780407dba917abeb6f69aa5, user_id=5b6086c8605c401986cb65ef7db9a749, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:49.034296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565251b0-ec4f-4ff0-98c6-d62ef5dc38f5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:49.049020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1128/2233] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:48 2022] PUT /identity/v3/projects/c5c8dffbd780407dba917abeb6f69aa5/users/5b6086c8605c401986cb65ef7db9a749/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:20:49.473271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:49.476109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:49.504282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925b34e-9e90-4187-bb48-6db3597c67b1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:49.596579 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:49.597512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:49.597796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:49.598353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] PATH_INFO: `/v3/users/36abee8c883d453c8aaf9dc99a18d4d4` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:49.599340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36abee8c883d453c8aaf9dc99a18d4d4)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:49.601328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:49.655493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36abee8c883d453c8aaf9dc99a18d4d4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:49.665402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36abee8c883d453c8aaf9dc99a18d4d4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:49.683086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36abee8c883d453c8aaf9dc99a18d4d4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:49.683990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36abee8c883d453c8aaf9dc99a18d4d4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:49.684685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36abee8c883d453c8aaf9dc99a18d4d4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:49.705519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1106/2234] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:49 2022] DELETE /identity/v3/users/36abee8c883d453c8aaf9dc99a18d4d4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:49.710164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:49.711041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:49.711547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:49.735673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:49.737246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:49.848934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1129/2235] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:49.859137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:49.860925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:49.950974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f4c0-95a0-4b1f-9eb7-7411ea26b7a3 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:49.957707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:49.958396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:49.958675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:49.958947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:49.969237 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:49.970712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a73c1b-5e93-4d03-a544-8d30b97c2f06 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:49.998196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1107/2236] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:20:50.418290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:50.420511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:50.433498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba72f86-62b4-48b1-b916-d0f9da9a7f36 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:50.439092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:50.439943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.440368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.440772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] PATH_INFO: `/v3/projects/cd99e2b4212b4168b970054088492af0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.442146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd99e2b4212b4168b970054088492af0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:50.444103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:50.506483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd99e2b4212b4168b970054088492af0', 'request_id': 'req-3a6b2c5a-8f89-4ccd-9193-53936bafa195'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:50.514402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd99e2b4212b4168b970054088492af0', 'request_id': 'req-3a6b2c5a-8f89-4ccd-9193-53936bafa195'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:50.524842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd99e2b4212b4168b970054088492af0', 'request_id': 'req-3a6b2c5a-8f89-4ccd-9193-53936bafa195'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:50.543091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] The token cache is being invalidate because project cd99e2b4212b4168b970054088492af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:20:50.543460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:50.544538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3a6b2c5a-8f89-4ccd-9193-53936bafa195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:50.547383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1130/2237] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:20:50 2022] DELETE /identity/v3/projects/cd99e2b4212b4168b970054088492af0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:50.553650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.554223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.554507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.573936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:50.575149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:50.640739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1108/2238] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:20:50.648200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.648489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.648764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.670311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:50.672431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:50.685061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1131/2239] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:50.685846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:50.696197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb4115-f327-4d63-a114-b67e68b63387 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:50.701072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:50.702010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.702478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.702756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.703497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:20:50.703955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:50.705592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:50.717632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1109/2240] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:20:50.723448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:50.735151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f401e4-67aa-4c08-998d-a1cea6cbbfd2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:50.740925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:50.742331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.742972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.743457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.744369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:50.746441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:50.781941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1132/2241] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:20:50 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:20:50.783241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:50.793952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fd1c2-0e3a-43fb-b897-c05ed2771fa9 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:50.901255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:50.902310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:50.902761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:50.903191 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:50.904097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:50.907152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:50.945891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1110/2242] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:20:50 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:20:50.949983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:50.981089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1f41a-f53d-4206-85cd-2e994afa76ed admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:51.002468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:51.003221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:51.003505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:51.003815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:51.004714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:51.007117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:51.038103 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1133/2243] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:51.039431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:51.054457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72728376-5a28-4e42-9cf0-6a178840c51f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:51.067565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:51.068541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:51.069039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:51.069665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:51.072300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:51.074272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7be2-a673-4703-913c-430f28aefc91 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:51.090255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1111/2244] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:20:51.094510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:51.115743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7fc20-3ea3-440c-be43-d9d27dc5e91b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:51.125787 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:51.127265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:51.127906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:51.128369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] PATH_INFO: `/v3/projects/f1ae04ae72524cad8df7d557c2db1755/users/376c54b9ed1b447bb60e4eafb246774d/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:51.154702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ae04ae72524cad8df7d557c2db1755, user_id=376c54b9ed1b447bb60e4eafb246774d, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:51.157840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:51.173752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1134/2245] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:20:51 2022] PUT /identity/v3/projects/f1ae04ae72524cad8df7d557c2db1755/users/376c54b9ed1b447bb60e4eafb246774d/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:51.180518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7e08-7090-41ae-9a0b-c495b4ac56c6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:51.180802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7e08-7090-41ae-9a0b-c495b4ac56c6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:51.181607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7e08-7090-41ae-9a0b-c495b4ac56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:51.211657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0b5e7e08-7090-41ae-9a0b-c495b4ac56c6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:51.214432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0b5e7e08-7090-41ae-9a0b-c495b4ac56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:51.300056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1112/2246] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:51.310293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:51.313072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:51.384384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf60c4b-b747-4782-8603-521d67da5ef3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:51.389451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:51.390942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:51.391230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:51.391545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:51.402506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:51.404001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:51.415543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1135/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:56.552114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:56.552577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:56.552674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:56.602529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] MFA Rules not processed for user `5b6086c8605c401986cb65ef7db9a749`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:56.603887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:56.794349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1113/2248] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:56.812236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:56.814250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:56.946703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1586-288e-4a41-8d3b-11589c6c4a0c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:56.964625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:56.965420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:56.965737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:56.966231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:56.968391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:57.079733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:57.082321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0bb67-2f44-4de4-94a9-3ab864b03053 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:57.095151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1136/2249] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:20:59.478123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:59.479540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:59.507214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35386-d47f-44f1-8fc4-e51d87f8d9ea None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:20:59.527161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:20:59.528127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:59.528474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:59.528706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] PATH_INFO: `/v3/users/44b51b1150554da38890780ece3d3a6d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:59.534746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b51b1150554da38890780ece3d3a6d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:20:59.537601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:20:59.672399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b51b1150554da38890780ece3d3a6d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:59.690717 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b51b1150554da38890780ece3d3a6d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:59.700117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b51b1150554da38890780ece3d3a6d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:59.701776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b51b1150554da38890780ece3d3a6d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:59.703388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b51b1150554da38890780ece3d3a6d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:20:59.732461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1114/2250] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:20:59 2022] DELETE /identity/v3/users/44b51b1150554da38890780ece3d3a6d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:20:59.737354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059978c-c92f-4d35-b43f-03b875880bc0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:59.737966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059978c-c92f-4d35-b43f-03b875880bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:59.740461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059978c-c92f-4d35-b43f-03b875880bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:59.762244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c059978c-c92f-4d35-b43f-03b875880bc0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:59.764296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c059978c-c92f-4d35-b43f-03b875880bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:59.872785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1137/2251] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:20:59.892038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:20:59.892038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:20:59.902914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:20:59.903446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:20:59.903770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:20:59.945921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] MFA Rules not processed for user `376c54b9ed1b447bb60e4eafb246774d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:20:59.947528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:00.056987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9678dcd-2810-4211-b4bc-5a31e7a7b833 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.077680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.078550 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.078974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.079430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.087420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1138/2252] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:00.094529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.097823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:00.113820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.116675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.129262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032ca9-1eaa-4b31-b94c-2fef4c93dcd5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.146006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.146193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.146411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1115/2253] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:00.162190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.162584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.163522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.167727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.254277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1139/2254] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:00 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:00.258973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.277993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a333e44-d7f3-497b-b0f3-00b882f9da84 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.461366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.462065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.462353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.462631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.463631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.466772 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.524946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1116/2255] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:00 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:00.526593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.541615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa460ef2-d6c0-4e12-8364-91bb451aa444 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.552394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.553433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.553964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.554881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.555742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.559338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.591352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1140/2256] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:00.592355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.645063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.650384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e295ed2-76cf-4c49-bbc1-8712397511c6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.652732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:00.665907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.666965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.669193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.669580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] PATH_INFO: `/v3/projects/d24f7d234fe34efe87983225b2a12243/users/c1fd8af095b3490fa4a4774e5a9b86bb/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.712780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24f7d234fe34efe87983225b2a12243, user_id=c1fd8af095b3490fa4a4774e5a9b86bb, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.726575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.742080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdebf-e523-45bd-af21-5f5433c3eb51 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:00.766266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:00.768971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.769449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.769980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] PATH_INFO: `/v3/projects/93badfe81d394b2d99aeb3ae491e4899` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:00.772953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93badfe81d394b2d99aeb3ae491e4899)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:00.775641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:00.782511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1117/2257] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:00 2022] PUT /identity/v3/projects/d24f7d234fe34efe87983225b2a12243/users/c1fd8af095b3490fa4a4774e5a9b86bb/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:21:00.786676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:00.860246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93badfe81d394b2d99aeb3ae491e4899', 'request_id': 'req-8cb082a9-f995-4f59-9d05-a23a8aae3f43'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:00.893411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93badfe81d394b2d99aeb3ae491e4899', 'request_id': 'req-8cb082a9-f995-4f59-9d05-a23a8aae3f43'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:00.911676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93badfe81d394b2d99aeb3ae491e4899', 'request_id': 'req-8cb082a9-f995-4f59-9d05-a23a8aae3f43'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:00.952392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] The token cache is being invalidate because project 93badfe81d394b2d99aeb3ae491e4899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:00.953090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:00.958161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8cb082a9-f995-4f59-9d05-a23a8aae3f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:00.961549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1141/2258] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:00 2022] DELETE /identity/v3/projects/93badfe81d394b2d99aeb3ae491e4899 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:00.966200 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c938-3d24-4707-b7a6-1943ee1a9a82 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:00.966696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c938-3d24-4707-b7a6-1943ee1a9a82 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:00.967119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c938-3d24-4707-b7a6-1943ee1a9a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.037700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-6078c938-3d24-4707-b7a6-1943ee1a9a82 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:01.039947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cb6f1-ad02-47fd-bf1b-ee1a03583d2b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.041726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6078c938-3d24-4707-b7a6-1943ee1a9a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:01.198660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.200999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.201571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.202088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.207043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.212380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.233227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1118/2259] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:01.243783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.246080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:01.265472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1142/2260] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:01.268248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9db24-d911-415a-be7c-1bd50231e505 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.272208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.276263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.276789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.283318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.284252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.284536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.284835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] PATH_INFO: `/v3/projects/d24f7d234fe34efe87983225b2a12243/users/c1fd8af095b3490fa4a4774e5a9b86bb/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.290678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24f7d234fe34efe87983225b2a12243, user_id=c1fd8af095b3490fa4a4774e5a9b86bb, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.299245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.321255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1119/2261] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:01 2022] PUT /identity/v3/projects/d24f7d234fe34efe87983225b2a12243/users/c1fd8af095b3490fa4a4774e5a9b86bb/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:01.329170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:01.330862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:01.435563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1143/2262] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:01.439820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.453929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd02f9-273c-4166-b701-04cda468e7a5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.464578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.465056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.465340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.465615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.466348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:21:01.466649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.468806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.495228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1120/2263] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:21:01.501066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.523491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b665-e7b9-4e3a-9dca-aa85bbe9205f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.531005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.531681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.531965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.532241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.533575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.536316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.588231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1144/2264] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:01 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:01.592070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.603865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba458ed-7538-435f-89c5-09bd87045212 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.732500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.733649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.734317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.734738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.735744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.738377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.771695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1121/2265] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:01 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:21:01.776054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.787830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3a7d-dd2f-4e87-8112-dd493367d8be admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.795337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.796599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.796954 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.797318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.801265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.801265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.817792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1145/2266] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:01.821811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.840426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e833-b67c-4e6e-a17f-5149ccd89f37 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.847395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.851793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.852129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.852409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.853388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.855014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64642c8-a7de-42a8-82de-51420727deeb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.882851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1122/2267] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:01.887719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:01.899168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d922c8-a44b-494e-8bde-1a792d28ccab admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:01.905911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:01.906968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.908135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.908421 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] PATH_INFO: `/v3/projects/7f4391cef9d040b782c955dcc89fea66/users/4c48844b6f2e4ecc817b66efa3106a2a/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:01.951672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4391cef9d040b782c955dcc89fea66, user_id=4c48844b6f2e4ecc817b66efa3106a2a, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:01.954880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:01.982625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1146/2268] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:01 2022] PUT /identity/v3/projects/7f4391cef9d040b782c955dcc89fea66/users/4c48844b6f2e4ecc817b66efa3106a2a/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:01.994863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:01.995159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:01.995401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.031255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] MFA Rules not processed for user `4c48844b6f2e4ecc817b66efa3106a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:02.032778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:02.118763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1123/2269] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:02.122675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.210182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab87d-6b1d-463f-9c59-69929dba1d4d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.226674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.227494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.227887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.228417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.229312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.232178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.275045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1147/2270] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:02 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:02.278729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.291213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e5e5-e78f-4e02-9f48-f9b37a2a9797 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.383770 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.384998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.385540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.386059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.387655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.395176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.419402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1124/2271] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:02 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:02.423527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.446769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca253a1-4ca8-425c-b0ce-6d408652a0b0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.452396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.453077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.453453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.453734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.454466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.456074 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.494273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1148/2272] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:02.494990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.505636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401b4a-f587-4df5-88e2-1d405e540f24 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.510787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.512208 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.512665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.513122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.516438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.518512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726baec3-2f38-41b4-992a-24b01690ec9d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.535728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.541188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1125/2273] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:21:02.547230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a110e-73af-4fb3-8970-f779f2c421d2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.552156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.553333 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.553806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.565866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] PATH_INFO: `/v3/projects/d0ac6f4155d846ac9b0bbb229a03ad14/users/aefed229452248a184423c451dbb4afc/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.596367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ac6f4155d846ac9b0bbb229a03ad14, user_id=aefed229452248a184423c451dbb4afc, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.609808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.635358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1149/2274] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:02 2022] PUT /identity/v3/projects/d0ac6f4155d846ac9b0bbb229a03ad14/users/aefed229452248a184423c451dbb4afc/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:02.647145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.647961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.648303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.684313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] MFA Rules not processed for user `aefed229452248a184423c451dbb4afc`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:02.685741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:02.821335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1126/2275] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:02.825476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.935460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909490c5-46d0-469f-8571-cc11cb146078 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:02.941119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:02.941830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:02.942121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:02.942401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:02.943106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:02.945369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:02.972219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1150/2276] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:02 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:02.975959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:02.990992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa80b61-8f92-4405-8cc8-13c276df8255 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.084937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.085659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.085995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.086385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.087731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.089888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.115607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1127/2277] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:02 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:21:03.119373 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:03.133305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ac59-55ad-4da3-b580-8f5688fec347 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.138558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.140142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.140624 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.141366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.142881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.145350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.180942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:03.181139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1151/2278] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:03.196295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6aee1b-554f-467c-bfd7-f9931b8f8dca admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.201929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.203093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.203377 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.203655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] PATH_INFO: `/v3/projects/29b645ad670244ea983cf2820fc6dda7/users/dce7564092574733b8eb571be0086034/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.223444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b645ad670244ea983cf2820fc6dda7, user_id=dce7564092574733b8eb571be0086034, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.226609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.240688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1128/2279] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:03 2022] PUT /identity/v3/projects/29b645ad670244ea983cf2820fc6dda7/users/dce7564092574733b8eb571be0086034/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:03.244679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:03.255918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8e7d0-a652-4880-af3d-72089be734ca admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.325924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.326601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.326882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.327312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.328049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.329969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351df563-dd93-49c7-9c48-677b90196f35 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.341932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1152/2280] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:03.346019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:03.369182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe3ee-f526-4841-957c-8f3ec3a5dc65 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.374189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.375280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.375617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.375896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] PATH_INFO: `/v3/projects/29b645ad670244ea983cf2820fc6dda7/users/dce7564092574733b8eb571be0086034/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.378046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b645ad670244ea983cf2820fc6dda7, user_id=dce7564092574733b8eb571be0086034, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.380742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.427838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1129/2281] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:03 2022] PUT /identity/v3/projects/29b645ad670244ea983cf2820fc6dda7/users/dce7564092574733b8eb571be0086034/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:03.429453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.429752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.430039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.466450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] MFA Rules not processed for user `dce7564092574733b8eb571be0086034`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:03.467183 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:03.567693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1153/2282] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:03.581489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:03.583363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:03.658954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62df8e1-cbe0-468e-9d37-08d1915b49b0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:03.663043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:03.663889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:03.668199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:03.668711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:03.743728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:03.745089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:03.774871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1130/2283] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:05.678467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:05.695655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f214e-59f6-4c19-b527-39abc2a5f3ab None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:05.699589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:05.700407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:05.700701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:05.700979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:05.791067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:05.792756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8bfac-f9f7-4829-beff-328fdf390a19 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:05.816210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1154/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:21:06.650825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:06.668948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50524138-8633-40e5-b83a-99dc83f11beb service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:06.674761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:06.675479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:06.675958 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:06.676419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:06.712224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:06.714242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:06.733778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1131/2285] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:08.603099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489c69f-b0d0-4003-b7e5-b9694da48ebc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:08.603559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489c69f-b0d0-4003-b7e5-b9694da48ebc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:08.603635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489c69f-b0d0-4003-b7e5-b9694da48ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:08.681793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5489c69f-b0d0-4003-b7e5-b9694da48ebc None None] MFA Rules not processed for user `c1fd8af095b3490fa4a4774e5a9b86bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:08.683934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5489c69f-b0d0-4003-b7e5-b9694da48ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:08.826796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1155/2286] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:11.101797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:11.213632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c471a2-1b84-4d20-b113-5f383e675ec1 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:11.219048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:11.219924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:11.220199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:11.220642 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] PATH_INFO: `/v3/users/4c48844b6f2e4ecc817b66efa3106a2a` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:11.222038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c48844b6f2e4ecc817b66efa3106a2a)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:11.224257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:11.272653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c48844b6f2e4ecc817b66efa3106a2a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:11.280829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c48844b6f2e4ecc817b66efa3106a2a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:11.289383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c48844b6f2e4ecc817b66efa3106a2a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:11.290071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c48844b6f2e4ecc817b66efa3106a2a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:11.291414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c48844b6f2e4ecc817b66efa3106a2a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:11.310176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1132/2287] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:21:11 2022] DELETE /identity/v3/users/4c48844b6f2e4ecc817b66efa3106a2a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:11.314814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:11.315340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:11.315428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:11.364706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:11.365971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:11.458863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1156/2288] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:11.469122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:11.471035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:11.615082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d1df-64db-4594-b5c3-b2dabb696010 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:11.630659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:11.631395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:11.631606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:11.631879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:11.643262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:11.644682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:11.657041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1133/2289] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:21:11.956903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:11.960875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:12.007789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cfb49-cc15-4d34-921b-515df234fb42 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:12.021829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:12.024140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:12.024854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:12.028878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] PATH_INFO: `/v3/projects/7f4391cef9d040b782c955dcc89fea66` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:12.034431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4391cef9d040b782c955dcc89fea66)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:12.036630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:12.112718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4391cef9d040b782c955dcc89fea66', 'request_id': 'req-91b00db1-c612-4d58-83a4-5eb1f6157fe9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.120737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4391cef9d040b782c955dcc89fea66', 'request_id': 'req-91b00db1-c612-4d58-83a4-5eb1f6157fe9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.128034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4391cef9d040b782c955dcc89fea66', 'request_id': 'req-91b00db1-c612-4d58-83a4-5eb1f6157fe9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.162264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] The token cache is being invalidate because project 7f4391cef9d040b782c955dcc89fea66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:12.162567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.163387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.168817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1157/2290] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:11 2022] DELETE /identity/v3/projects/7f4391cef9d040b782c955dcc89fea66 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:12.169974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:12.190004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2089bd-4546-475d-95f7-8a82d0e8eb5a service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:12.271130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:12.271838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:12.272414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:12.272897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] PATH_INFO: `/v3/users/aefed229452248a184423c451dbb4afc` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:12.274756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefed229452248a184423c451dbb4afc)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:12.277328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:12.338356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefed229452248a184423c451dbb4afc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.346203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefed229452248a184423c451dbb4afc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.354382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefed229452248a184423c451dbb4afc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.355192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefed229452248a184423c451dbb4afc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.355904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefed229452248a184423c451dbb4afc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:12.377615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1134/2291] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:21:12 2022] DELETE /identity/v3/users/aefed229452248a184423c451dbb4afc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:21:12.832485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:12.835675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:12.864929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b00db1-c612-4d58-83a4-5eb1f6157fe9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:12.973665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:12.974978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:12.975428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:12.975926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] PATH_INFO: `/v3/projects/d0ac6f4155d846ac9b0bbb229a03ad14` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:12.977281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ac6f4155d846ac9b0bbb229a03ad14)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:12.979296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:13.044270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ac6f4155d846ac9b0bbb229a03ad14', 'request_id': 'req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.052075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ac6f4155d846ac9b0bbb229a03ad14', 'request_id': 'req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.058647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ac6f4155d846ac9b0bbb229a03ad14', 'request_id': 'req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.078685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] The token cache is being invalidate because project d0ac6f4155d846ac9b0bbb229a03ad14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:13.078974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.079835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.087353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:13.088883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1158/2292] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:12 2022] DELETE /identity/v3/projects/d0ac6f4155d846ac9b0bbb229a03ad14 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:13.090135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:13.103903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddd879-252a-4200-9c3f-a97fee9a24a3 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:13.169672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:13.171508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:13.172113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:13.172113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] PATH_INFO: `/v3/users/dce7564092574733b8eb571be0086034` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:13.173607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce7564092574733b8eb571be0086034)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:13.175932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:13.232878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce7564092574733b8eb571be0086034'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.241129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce7564092574733b8eb571be0086034'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.249646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce7564092574733b8eb571be0086034'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.250428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce7564092574733b8eb571be0086034'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.251258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7b27dfd-7c62-4849-aba7-fb4ff9c205e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce7564092574733b8eb571be0086034'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.279344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1135/2293] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:21:13 2022] DELETE /identity/v3/users/dce7564092574733b8eb571be0086034 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:13.751164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:13.752601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:13.768652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1800a6-2bc1-4b54-ba2f-963a09f9a1c9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:13.843915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:13.845707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:13.845993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:13.846268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] PATH_INFO: `/v3/projects/29b645ad670244ea983cf2820fc6dda7` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:13.847515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b645ad670244ea983cf2820fc6dda7)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:13.849602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:13.884004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de8c9-8254-4c00-829c-600ecd2cda0d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:13.884799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de8c9-8254-4c00-829c-600ecd2cda0d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:13.885464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de8c9-8254-4c00-829c-600ecd2cda0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:13.922930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b645ad670244ea983cf2820fc6dda7', 'request_id': 'req-7c27a18b-797a-472d-9895-1fbd884cb5b7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.928145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8e7de8c9-8254-4c00-829c-600ecd2cda0d None None] MFA Rules not processed for user `6d960067f49b43a7bd26af6c0a20d369`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:13.929261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b645ad670244ea983cf2820fc6dda7', 'request_id': 'req-7c27a18b-797a-472d-9895-1fbd884cb5b7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.929618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8e7de8c9-8254-4c00-829c-600ecd2cda0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:13.934591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b645ad670244ea983cf2820fc6dda7', 'request_id': 'req-7c27a18b-797a-472d-9895-1fbd884cb5b7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.958210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] The token cache is being invalidate because project 29b645ad670244ea983cf2820fc6dda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:13.958548 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.969832 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7c27a18b-797a-472d-9895-1fbd884cb5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:13.973755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1159/2294] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:13 2022] DELETE /identity/v3/projects/29b645ad670244ea983cf2820fc6dda7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:13.979226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795be7-951f-4633-bd28-a37d27955583 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:13.982090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795be7-951f-4633-bd28-a37d27955583 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:13.982401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795be7-951f-4633-bd28-a37d27955583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.029636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1136/2295] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:14.046576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-42795be7-951f-4633-bd28-a37d27955583 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:14.050655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-42795be7-951f-4633-bd28-a37d27955583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:14.128819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1160/2296] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:14.138149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.138776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.139950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.166150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:14.167396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:14.178036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1137/2297] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:14.182451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795be7-951f-4633-bd28-a37d27955583 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.192849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795be7-951f-4633-bd28-a37d27955583 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.203280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.203966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.204248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.204521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.205292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:21:14.205601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.207239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.223364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1161/2298] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:21:14.225059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.239506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782969d-bdac-4ea7-a822-93dbb3bf4c58 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.244570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.245387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.245767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.246139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.246926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.250801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.286687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1138/2299] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:14 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:14.291170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.303649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06614418-31a3-4473-8d1c-e185eb31132c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.381082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.381837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.382306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.382585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.383859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.385599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.416219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1162/2300] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:14 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:14.420134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.433652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66fd6-5e5c-4f44-8f26-d0778164e619 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.439093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.439902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.440303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.440582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.441514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.443117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.453998 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1139/2301] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:14.458102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.468844 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301bb1e-ef7b-4872-b72f-286abf562f5a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.474772 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.475570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.475915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.476259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.477088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.478815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c8499-37ea-4d98-9914-6352cd6a92fb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.492559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1163/2302] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:14.498105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.509306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b107ce-4a6a-406f-9887-468f6120d0b8 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.514888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.515839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.516183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.516519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] PATH_INFO: `/v3/projects/5a1550e84e0440c6b85466cc7047859f/users/2f96d9049b5e439fa3471d6078ac4504/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.531919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1550e84e0440c6b85466cc7047859f, user_id=2f96d9049b5e439fa3471d6078ac4504, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.534734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.548782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1140/2303] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:14 2022] PUT /identity/v3/projects/5a1550e84e0440c6b85466cc7047859f/users/2f96d9049b5e439fa3471d6078ac4504/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:14.560320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.560617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.560923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.595302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] MFA Rules not processed for user `2f96d9049b5e439fa3471d6078ac4504`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:14.597028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:14.664932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1164/2304] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:14.676470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.678136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:14.747974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7faea-a72f-4780-937a-26826c66ba19 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:14.752203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:14.752856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:14.753136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:14.753440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:14.763258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:14.765303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de324c-ea63-4618-8c50-98ddf522fcff service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:14.774934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1141/2305] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:14.987946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:14.989789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:15.070669 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf2058-866c-4bef-9aa1-7a0f1d495b19 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:15.074449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:15.075141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:15.075604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:15.075892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:15.078256 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:15.171323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:15.173168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:15.183578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1165/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:15.342033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:15.342533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:15.342624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:15.360542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:15.361811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:15.427892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1142/2307] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:21:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:15.471341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:15.472742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:15.540383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36b0a4-3712-448c-b598-92410456b13c service glance] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:15.545267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:15.545914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:15.546194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:15.546613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:15.554903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:15.556473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc2db8-5188-4817-8dd7-4c80df96500c service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:15.564811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1166/2308] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:21:17.636189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:17.725246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9d641-8901-40a9-a630-80e5c0ca0b72 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:17.733393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:17.734711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:17.735265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:17.735795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] PATH_INFO: `/v3/users/2f96d9049b5e439fa3471d6078ac4504` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:17.739116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f96d9049b5e439fa3471d6078ac4504)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:17.741169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:17.800950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f96d9049b5e439fa3471d6078ac4504'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:17.810362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f96d9049b5e439fa3471d6078ac4504'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:17.819999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f96d9049b5e439fa3471d6078ac4504'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:17.820681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f96d9049b5e439fa3471d6078ac4504'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:17.821944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f96d9049b5e439fa3471d6078ac4504'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:17.845839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1143/2309] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:21:17 2022] DELETE /identity/v3/users/2f96d9049b5e439fa3471d6078ac4504 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:17.850435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:17.851338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:17.851780 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:17.873036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:17.874956 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:17.950996 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1167/2310] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:17.961389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:17.963361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:18.059057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530545ea-7280-4710-bf6a-f7aaa1fcdfde admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:18.063747 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:18.064518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:18.064874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:18.065251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:18.100002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:18.101686 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029eaf6-da55-421e-8491-5c755671452a service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:18.112827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1144/2311] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:18.676788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:18.678268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:18.690608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ddc0-00a4-4fba-81f4-eb64a52f4dcc None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:18.699365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:18.700493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:18.700946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:18.701447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] PATH_INFO: `/v3/projects/5a1550e84e0440c6b85466cc7047859f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:18.702863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1550e84e0440c6b85466cc7047859f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:18.724212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:18.827702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1550e84e0440c6b85466cc7047859f', 'request_id': 'req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:18.842173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1550e84e0440c6b85466cc7047859f', 'request_id': 'req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:18.854929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1550e84e0440c6b85466cc7047859f', 'request_id': 'req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:18.877989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] The token cache is being invalidate because project 5a1550e84e0440c6b85466cc7047859f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:18.878703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:18.879752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2507e2cf-65a7-42e1-81a8-65ebdbc7398a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:18.881608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1168/2312] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:18 2022] DELETE /identity/v3/projects/5a1550e84e0440c6b85466cc7047859f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:18.886780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:18.887317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:18.887317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:18.909814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:18.911371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:19.045587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.045882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.046169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.057814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1145/2313] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:19.082965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:19.084224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:19.105988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1169/2314] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:19.107252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.120105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ff82-72e4-4b8f-bab8-e60acb3b3371 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.136099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.137097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.137442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.137705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.138522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:21:19.138935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.140567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.162911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1146/2315] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:21:19.166113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.187111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345d1c-ef96-4965-bb98-7e1302012d6e None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.210934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.211701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.212170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.212457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.213173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.216745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.274059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1170/2316] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:19 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:21:19.277956 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.290860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654efec7-0da0-4c70-9c61-c0efff3fc1c1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.379620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.380363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.380601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.380893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.381728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.383816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.410156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1147/2317] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:19 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:21:19.414211 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.425515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7fddf-6470-4439-a35f-1f37eae63676 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.431648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.432837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.432837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.432837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.433657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.435845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.475607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1171/2318] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:19.476768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.490726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9344db-8700-4eed-875a-c94fffc0f827 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.513542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.514849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.515088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.515406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.516101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.517811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598670e-0494-4f82-850b-e6389b7df4fd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.535289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1148/2319] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:19.536828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.550193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b1db9-b278-4892-9a51-e0dd55a67f94 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.555313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.556195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.556476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.556766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] PATH_INFO: `/v3/projects/3dcb691e6baf4935a58b3b1f2d7cf51a/users/43acade68a9b48aa9fcb0afdcd381b0c/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.575719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcb691e6baf4935a58b3b1f2d7cf51a, user_id=43acade68a9b48aa9fcb0afdcd381b0c, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.579513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.600917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1172/2320] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:19 2022] PUT /identity/v3/projects/3dcb691e6baf4935a58b3b1f2d7cf51a/users/43acade68a9b48aa9fcb0afdcd381b0c/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:19.611091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550626e2-f708-417a-bfb3-a5e40c7a0ae9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.611393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550626e2-f708-417a-bfb3-a5e40c7a0ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.612006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550626e2-f708-417a-bfb3-a5e40c7a0ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.645990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-550626e2-f708-417a-bfb3-a5e40c7a0ae9 None None] MFA Rules not processed for user `43acade68a9b48aa9fcb0afdcd381b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:19.647209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-550626e2-f708-417a-bfb3-a5e40c7a0ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:19.729246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1149/2321] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:19.740781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:19.742508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:19.818926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e924-77f7-4713-bf8c-303c08ba5d74 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:19.824872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:19.825425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:19.825785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:19.826145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:19.840164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:19.841782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17108-db67-4f04-9329-7a7dd55b4da9 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:19.854581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1173/2322] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:23.340647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:23.341225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:23.341225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:23.379234 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:23.380723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:23.486079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38fb7-c331-4197-80af-794fa8cb4e55 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:23.486666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38fb7-c331-4197-80af-794fa8cb4e55 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:23.486666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38fb7-c331-4197-80af-794fa8cb4e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:23.500014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1150/2323] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:23.524022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:23.525918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:23.529523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-cad38fb7-c331-4197-80af-794fa8cb4e55 None None] MFA Rules not processed for user `43acade68a9b48aa9fcb0afdcd381b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:23.530929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cad38fb7-c331-4197-80af-794fa8cb4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:23.562137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1174/2324] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:23.646900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ffb37-804e-4019-9ad2-5d1f1f87de7f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:23.653458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:23.655681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:23.656088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:23.656487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:23.669335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:23.671645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f174cb-c9f3-4da8-be1f-6d5d2748d67f service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:23.696682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1151/2325] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:21:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:21:26.354938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:26.355536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:26.355536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:26.374546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] MFA Rules not processed for user `376c54b9ed1b447bb60e4eafb246774d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:26.377101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:26.441936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1175/2326] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:30.099969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10a00-0c12-4213-9e28-80339507e24e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:30.100558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10a00-0c12-4213-9e28-80339507e24e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:30.100558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10a00-0c12-4213-9e28-80339507e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:30.129576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-efc10a00-0c12-4213-9e28-80339507e24e None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:30.131093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-efc10a00-0c12-4213-9e28-80339507e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:30.160006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1152/2327] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:21:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:30.178842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:30.198612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25925c20-d946-4d3a-ae0f-48559dc3cd30 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:30.204868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:30.205914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:30.206427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:30.206923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:30.217223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:30.219167 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35b607-82c7-4db2-bf03-875675bf8a0c service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:30.233354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1176/2328] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:21:32.033308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:32.034260 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:32.034702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:32.071159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] MFA Rules not processed for user `2b7f4e19dcdf475bb44bb51597281a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:32.075885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:32.236481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1153/2329] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:45.692276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:45.693178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:45.693493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:45.711946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:45.713154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:45.721131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1177/2330] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:21:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:45.742439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:45.754865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaa4e2-0f3f-4208-8d36-75e6737f5de6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:45.760149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:45.760974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:45.761281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:45.761825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:45.773088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:45.775091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:45.786576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1154/2331] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:21:50.029429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.031005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:50.105260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4016-26dd-4a11-b71c-31b54bf88e4a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.111790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.112796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.113332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.113716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] PATH_INFO: `/v3/users/a5876d477f6d45ddb1f1f68a05c06abd` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.115370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5876d477f6d45ddb1f1f68a05c06abd)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.118253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:50.166980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5876d477f6d45ddb1f1f68a05c06abd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.174117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5876d477f6d45ddb1f1f68a05c06abd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.183307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5876d477f6d45ddb1f1f68a05c06abd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.184068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5876d477f6d45ddb1f1f68a05c06abd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.199888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1917fffe-e9f5-422d-a27a-c5a0b23d1a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5876d477f6d45ddb1f1f68a05c06abd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.208827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1178/2332] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:21:50 2022] DELETE /identity/v3/users/a5876d477f6d45ddb1f1f68a05c06abd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:50.498817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.512529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b1b48-36c1-447e-b895-8d68c2ef764e service swift] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.581155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.582038 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.582322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.582596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] PATH_INFO: `/v3/projects/614d448623c04d6ba6f08e1752b28273` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.583767 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=614d448623c04d6ba6f08e1752b28273)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.585720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:50.628979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614d448623c04d6ba6f08e1752b28273', 'request_id': 'req-b4f86494-d762-435e-8c1c-aebc5a8257ee'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.634188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614d448623c04d6ba6f08e1752b28273', 'request_id': 'req-b4f86494-d762-435e-8c1c-aebc5a8257ee'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.642044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614d448623c04d6ba6f08e1752b28273', 'request_id': 'req-b4f86494-d762-435e-8c1c-aebc5a8257ee'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.652949 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] The token cache is being invalidate because project 614d448623c04d6ba6f08e1752b28273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:21:50.653287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.654542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b4f86494-d762-435e-8c1c-aebc5a8257ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:21:50.656084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1155/2333] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:21:50 2022] DELETE /identity/v3/projects/614d448623c04d6ba6f08e1752b28273 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:50.661020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.661335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.661617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.690122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:50.691416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:50.754209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1179/2334] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:50.762263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.762555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.762866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.781182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:50.783230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:50.790412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1156/2335] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:50.795114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.804860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100f35d-3697-446a-be65-88bc536faa3c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.809511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.810708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.810989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.811263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.811994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:21:50.812300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.813941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:50.826126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1180/2336] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:21:50.830401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.839465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b62a-860f-49e5-bb16-37a26877353d None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.844216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.844870 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.845154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.845604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.846300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.848238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:50.873092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1157/2337] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:21:50 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:21:50.877335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.887365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0278f9-2380-4efa-a48a-12e2de21bfb3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.942078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.942746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.943033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.943307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.944003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.945973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:50.964735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1181/2338] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:21:50 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:21:50.968729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:50.980983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f69f-f7f9-495c-b08b-eb636d6a1668 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:50.987522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:50.988919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:50.989273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:50.989605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:50.990432 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:50.992068 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:51.004098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1158/2339] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:51.008488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:51.019005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39e55-b092-40c4-a011-df52800487f7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:51.023616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:51.024290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:51.024575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:51.024853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:51.025609 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:51.027207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27b0ec-665f-48e0-b41e-d41577e840c8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:51.036784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1182/2340] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:21:51.040915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:51.051142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1b3b-8e82-4c97-817b-6259dd3a5c57 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:51.055865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:51.056729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:51.057031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:51.057330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] PATH_INFO: `/v3/projects/5aafa043964c4096a22bb7df43a432bb/users/b0ba2df75e3a4f89831c7077b6a39993/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:51.071647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aafa043964c4096a22bb7df43a432bb, user_id=b0ba2df75e3a4f89831c7077b6a39993, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:51.074343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:51.086604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1159/2341] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:21:51 2022] PUT /identity/v3/projects/5aafa043964c4096a22bb7df43a432bb/users/b0ba2df75e3a4f89831c7077b6a39993/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:21:51.096403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448605-daab-4b97-b268-102752fbd0be None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:51.096694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448605-daab-4b97-b268-102752fbd0be None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:51.097000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d448605-daab-4b97-b268-102752fbd0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:51.123267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7d448605-daab-4b97-b268-102752fbd0be None None] MFA Rules not processed for user `b0ba2df75e3a4f89831c7077b6a39993`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:51.124522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7d448605-daab-4b97-b268-102752fbd0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:51.186558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1183/2342] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:21:51.197867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:51.199570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:51.255143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f699e2-5047-410f-bfdb-5418e1769737 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:51.258779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:51.259423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:51.259708 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:51.259981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:51.268810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:51.270308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:51.279043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1160/2343] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:21:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:21:54.511961 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:54.512569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:54.512673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:54.586364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:21:54.588977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:54.689031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1184/2344] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:21:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:21:54.702445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:21:54.704179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:21:54.860044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3220-5fd3-49bc-bf94-2c58917dd43c service glance] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:21:54.871946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:21:54.873118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:21:54.873647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:21:54.874165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:21:54.889340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:21:54.892507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351b664-86f6-43c2-bd5c-b89104b077aa service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:21:54.908046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1161/2345] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:21:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:10.978159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:10.979569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:11.034733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b1837-aaea-43a6-934f-8b2e69cca32b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:11.038276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:11.039004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:11.039285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:11.039632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:11.041514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:11.104738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:11.106234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:11.117515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1185/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:11.191083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c89897-011d-4dbe-b8d3-1e7c3c8ee229 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:11.191622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c89897-011d-4dbe-b8d3-1e7c3c8ee229 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:11.191622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c89897-011d-4dbe-b8d3-1e7c3c8ee229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:11.209759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-70c89897-011d-4dbe-b8d3-1e7c3c8ee229 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:11.210972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-70c89897-011d-4dbe-b8d3-1e7c3c8ee229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:11.219761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1162/2347] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:22:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:11.233140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:11.244910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a51a6-8d94-4dcc-a843-e9bd32b75ea8 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:11.251289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:11.252424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:11.252712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:11.252997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:11.263500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:11.265967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:11.276523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1186/2348] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:12.034636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8237-dbd0-48e2-bcb1-fad6ca6ca9c0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.034921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8237-dbd0-48e2-bcb1-fad6ca6ca9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.035195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f8237-dbd0-48e2-bcb1-fad6ca6ca9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.053402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-788f8237-dbd0-48e2-bcb1-fad6ca6ca9c0 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:12.054674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-788f8237-dbd0-48e2-bcb1-fad6ca6ca9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:12.062932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1163/2349] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:12.075612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:12.085840 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221205-fc82-41f2-8e2a-8578f07b2c8f service swift] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:12.092411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:12.093175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.093568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.093931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.102594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:12.104307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:12.113113 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1187/2350] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:12.334412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387d04-1768-4543-ba75-31fc2b4e8079 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.334882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387d04-1768-4543-ba75-31fc2b4e8079 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.334882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a387d04-1768-4543-ba75-31fc2b4e8079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.352428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9a387d04-1768-4543-ba75-31fc2b4e8079 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:12.353759 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9a387d04-1768-4543-ba75-31fc2b4e8079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:12.361615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1164/2351] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:12.374179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:12.384301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b3175-1e99-4c0f-aafc-d4c79b7f317f service swift] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:12.389570 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:12.390198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.390486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.390757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.398768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:12.400267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:12.409032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1188/2352] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:12.731887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.732170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.732466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.750080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:12.751295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:12.767429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1165/2353] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:22:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:12.780285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:12.790788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748ad4-3464-4051-872d-188a753b687a service swift] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:12.795873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:12.796610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:12.796960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:12.797363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:12.812556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:12.814347 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09c0e-b3b2-4097-88fd-9d34f487b709 service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:12.831783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1189/2354] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:13.464393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:13.466600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:13.638903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c570-9e0c-4534-a143-c218574b2f27 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:13.661854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:13.663154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:13.663539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:13.663918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:13.678860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:13.696233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:13.698325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c35a9-5b33-4dea-aff2-f6116971b797 service placement] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:13.711586 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1166/2355] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:15.107860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.109259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.109751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.111311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1190/2356] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:22:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:22:15.131529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03f7f5-fc9c-4627-a615-dcc773dc7c19 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.132138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03f7f5-fc9c-4627-a615-dcc773dc7c19 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.132264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03f7f5-fc9c-4627-a615-dcc773dc7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.185647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6f03f7f5-fc9c-4627-a615-dcc773dc7c19 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:15.186869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6f03f7f5-fc9c-4627-a615-dcc773dc7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:15.264601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1167/2357] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:15.277047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:15.278713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:15.320042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c3c54-679c-4312-a78a-0b70932ada54 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:15.323798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8d29f2955b4edaa93ecdd798ea4f62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:15.324448 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.324730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.325005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.335993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:15.337472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2f5e-97ea-4926-847a-bb7cd5494588 service glance] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:15.348574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1191/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:15.418205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933dba8-09f8-4725-a9dd-a5c8e624285f None None] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.418497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933dba8-09f8-4725-a9dd-a5c8e624285f None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.418773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933dba8-09f8-4725-a9dd-a5c8e624285f None None] PATH_INFO: `/` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.420713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1168/2359] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:22:15.430972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fd1bf-b3d8-4aca-8708-125a84b5e52f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.431316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fd1bf-b3d8-4aca-8708-125a84b5e52f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.431607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fd1bf-b3d8-4aca-8708-125a84b5e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.451237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-732fd1bf-b3d8-4aca-8708-125a84b5e52f None None] MFA Rules not processed for user `86b0cbde93e04bc2832ec379ccc001c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:15.452946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-732fd1bf-b3d8-4aca-8708-125a84b5e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:15.459612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1192/2360] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:22:15.471577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933dba8-09f8-4725-a9dd-a5c8e624285f None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:15.482459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933dba8-09f8-4725-a9dd-a5c8e624285f None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:15.485936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:15.486565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.486848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.487151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.494055 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:15.495491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799d7c9-32ed-4a62-9622-1f7cc0cd4f34 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:15.503771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1169/2361] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:15.586581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023002c7-0204-41ad-819f-65a4fdbf10ef None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.586900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023002c7-0204-41ad-819f-65a4fdbf10ef None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.587182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023002c7-0204-41ad-819f-65a4fdbf10ef None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.588569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1193/2362] 10.222.0.13 () {54 vars in 921 bytes} [Mon May 16 22:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:22:15.594930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c843-977c-4559-af37-979869c7f501 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.595535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c843-977c-4559-af37-979869c7f501 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.596425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c843-977c-4559-af37-979869c7f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.619289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9c49c843-977c-4559-af37-979869c7f501 None None] MFA Rules not processed for user `dd2eb7a2de50414587c7bd815d401959`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:15.620499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9c49c843-977c-4559-af37-979869c7f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:15.639549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1170/2363] 10.222.0.13 () {58 vars in 1018 bytes} [Mon May 16 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:15.650345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023002c7-0204-41ad-819f-65a4fdbf10ef None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:15.662068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023002c7-0204-41ad-819f-65a4fdbf10ef None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:15.665988 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:15.666816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:15.667267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:15.667682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:15.686934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:15.689009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b237c2-373e-4bae-9dd4-b06ba72e80fc service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:15.705623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1194/2364] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:18.563171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49c843-977c-4559-af37-979869c7f501 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:18.566629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9c49c843-977c-4559-af37-979869c7f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:18.656287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49c843-977c-4559-af37-979869c7f501 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:18.661014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:18.661930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:18.662279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:18.662553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] PATH_INFO: `/v3/users/43acade68a9b48aa9fcb0afdcd381b0c` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:18.663726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43acade68a9b48aa9fcb0afdcd381b0c)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:18.665701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:18.744967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43acade68a9b48aa9fcb0afdcd381b0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:18.755199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43acade68a9b48aa9fcb0afdcd381b0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:18.763066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43acade68a9b48aa9fcb0afdcd381b0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:18.764242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43acade68a9b48aa9fcb0afdcd381b0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:18.764844 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43acade68a9b48aa9fcb0afdcd381b0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:18.795131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1171/2365] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:22:18 2022] DELETE /identity/v3/users/43acade68a9b48aa9fcb0afdcd381b0c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:18.799923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:18.800459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:18.800541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:18.841350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:18.843784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:18.908012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1195/2366] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:18.917644 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:18.919100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:18.978066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fbb69-a2b7-4b0d-aacc-5364dd4d48dc admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:18.984501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:18.985800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:18.986222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:18.986628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:18.999342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:19.000990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6249-4d01-43e7-8989-9ac5ae6fe4d7 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:19.014147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1172/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:19.177802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:19.179245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:19.193042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959abd9-630f-4828-b1db-c51636d2f726 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:19.197846 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:19.198711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:19.198994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:19.199268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] PATH_INFO: `/v3/projects/3dcb691e6baf4935a58b3b1f2d7cf51a` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:19.200704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcb691e6baf4935a58b3b1f2d7cf51a)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:19.203240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:19.247495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'request_id': 'req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:19.254663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'request_id': 'req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:19.262031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcb691e6baf4935a58b3b1f2d7cf51a', 'request_id': 'req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:19.275459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] The token cache is being invalidate because project 3dcb691e6baf4935a58b3b1f2d7cf51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:22:19.275756 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:19.276376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fcff9929-82e7-42f2-b9cf-900b1c09ac4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:19.277980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1196/2368] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:22:19 2022] DELETE /identity/v3/projects/3dcb691e6baf4935a58b3b1f2d7cf51a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:23.010344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:23.010846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:23.011151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:23.028786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] MFA Rules not processed for user `11db1721d8a644dba09708e4feb4edd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:23.030537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:23.082366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1173/2369] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:23.953303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:23.953737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:23.953818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:23.975902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:23.977107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:24.056108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1197/2370] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:22:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:24.087151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:24.089135 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:24.178938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72535e95-b57f-4fd9-a618-68ceb2a8138c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:24.185387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:24.186203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:24.186489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:24.186784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:24.196901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:24.198696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:24.209154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1174/2371] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:22:24.372194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:24.374554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:24.454941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e3e8-a537-48c3-9e34-558083e13565 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:24.461659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:24.462847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:24.463415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:24.464036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:24.469438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:24.593452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:24.595141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a729c-a7be-4657-8963-8ec74e24f6f8 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:24.608150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1198/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:25.144943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:25.146743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:25.271568 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fe753-4755-4119-82ec-4b12de6dde4d service swift] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:25.276709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:25.277741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:25.278138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:25.278525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] PATH_INFO: `/v3/users/b0ba2df75e3a4f89831c7077b6a39993` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:25.279869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ba2df75e3a4f89831c7077b6a39993)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:25.281946 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:25.343216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ba2df75e3a4f89831c7077b6a39993'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:25.354961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ba2df75e3a4f89831c7077b6a39993'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:25.365599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ba2df75e3a4f89831c7077b6a39993'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:25.366556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ba2df75e3a4f89831c7077b6a39993'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:25.367172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ba2df75e3a4f89831c7077b6a39993'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:25.386030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1175/2373] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:22:25 2022] DELETE /identity/v3/users/b0ba2df75e3a4f89831c7077b6a39993 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:25.391425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:25.391943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:25.392025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:25.412011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:25.413408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:25.484523 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1199/2374] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:25.497562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:25.500063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:25.579905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c363f3-ccba-44c7-93ab-dc84e73f4a13 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:25.583941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:25.584710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:25.585092 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:25.585588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:25.597875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:25.601523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c740-34fd-4801-86b4-519b78539c2f service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:25.613657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1176/2375] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:26.064981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.066657 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:26.095703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecf358-84a2-4139-be2e-37299306cd09 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.101395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.102705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.103286 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.104502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] PATH_INFO: `/v3/projects/5aafa043964c4096a22bb7df43a432bb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.106009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aafa043964c4096a22bb7df43a432bb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.108597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.207757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aafa043964c4096a22bb7df43a432bb', 'request_id': 'req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:26.218977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aafa043964c4096a22bb7df43a432bb', 'request_id': 'req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:26.226934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aafa043964c4096a22bb7df43a432bb', 'request_id': 'req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:26.248283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] The token cache is being invalidate because project 5aafa043964c4096a22bb7df43a432bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:22:26.248752 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:26.250697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-fc7d4f76-b934-43c4-b13c-f23ee7e6357d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:26.254775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1200/2376] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:22:26 2022] DELETE /identity/v3/projects/5aafa043964c4096a22bb7df43a432bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:26.260108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.260652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.260894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.289577 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:26.291188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:26.380180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1177/2377] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:26.390466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.390903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.391296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.413982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:26.415945 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:26.424071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1201/2378] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:26.428309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.438266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8db15-9df9-40ca-b9d3-f5c5fb09b030 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.446724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.447520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.447906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.448279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.449107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:22:26.449540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.451810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.469259 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1178/2379] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:22:26.470457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.479930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268fb20-35fe-4803-bb1f-fc142ad92118 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.485886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.486696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.486994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.487345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.493987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.496855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.551190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1202/2380] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:22:26 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:22:26.555290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.566147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170a99-d99b-43fc-8b62-0eee413993b1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.667781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.668465 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.668749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.669029 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.669803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.671737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.697501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1179/2381] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:22:26 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:22:26.698881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.714768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fce13-002a-46e2-a91d-f8c1c452d0ad admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.720073 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.720751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.721034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.721472 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.722245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.723989 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.736094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1203/2382] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:22:26.740110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.750638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58b2f-ffad-498e-8960-f6d8d098e504 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.755803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.755987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.756232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.756510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.757258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.758866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0bf8-861c-4ad7-be4d-d7d90e6780cd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.771689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1180/2383] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:22:26.775908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:26.786367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97704a-8c89-4e73-98dc-e2f416e192a5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:26.791710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:26.792605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.792890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.793165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] PATH_INFO: `/v3/projects/ce04388a7dc74e2185b4eafc2fdc1367/users/f3fe01b4b532452c9d140f5e7e1e90f1/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.809877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce04388a7dc74e2185b4eafc2fdc1367, user_id=f3fe01b4b532452c9d140f5e7e1e90f1, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:26.813530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:26.832807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1204/2384] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:22:26 2022] PUT /identity/v3/projects/ce04388a7dc74e2185b4eafc2fdc1367/users/f3fe01b4b532452c9d140f5e7e1e90f1/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:22:26.843175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:26.843464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:26.843743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:26.903403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] MFA Rules not processed for user `f3fe01b4b532452c9d140f5e7e1e90f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:26.905541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:26.994181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1181/2385] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:27.007821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:27.010187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:27.160726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa28e-7718-470d-9a9c-caac44c51664 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:27.164701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:27.165493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:27.165879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:27.166277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:27.177634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:27.179266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5aecd-e971-48ee-86fa-7cdf26a82842 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:27.190585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1205/2386] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:22:27.222027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:27.307444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92fe0b-28ae-42cb-a4a7-d529d0c71421 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:27.313995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:27.314952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:27.315212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:27.320768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] PATH_INFO: `/v3/users/f3fe01b4b532452c9d140f5e7e1e90f1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:27.326753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fe01b4b532452c9d140f5e7e1e90f1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:27.333330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:27.435935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fe01b4b532452c9d140f5e7e1e90f1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:27.476269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fe01b4b532452c9d140f5e7e1e90f1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:27.525935 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fe01b4b532452c9d140f5e7e1e90f1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:27.527205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fe01b4b532452c9d140f5e7e1e90f1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:27.528105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fe01b4b532452c9d140f5e7e1e90f1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:27.560059 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1182/2387] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:22:27 2022] DELETE /identity/v3/users/f3fe01b4b532452c9d140f5e7e1e90f1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:27.573026 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:27.574033 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:27.574475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:27.595741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:27.597664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:27.682666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1206/2388] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:27.694024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:27.695754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:27.768925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00592-2c91-4027-b0f3-c408b533cea0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:27.772595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:27.773371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:27.773716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:27.774056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:27.788075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:27.789743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79343d-c2f2-455a-92ec-bc3bb298ebf0 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:27.805611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1183/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:28.144260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.146524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:28.166661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5a5cd-14fd-4e90-ae8e-18c980abf203 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.172433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.173503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.173901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.174291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] PATH_INFO: `/v3/projects/ce04388a7dc74e2185b4eafc2fdc1367` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.175786 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce04388a7dc74e2185b4eafc2fdc1367)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.178068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.226050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce04388a7dc74e2185b4eafc2fdc1367', 'request_id': 'req-f7f585b5-6ff3-46e6-b51c-886e4354b10f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:28.232946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce04388a7dc74e2185b4eafc2fdc1367', 'request_id': 'req-f7f585b5-6ff3-46e6-b51c-886e4354b10f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:28.238482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce04388a7dc74e2185b4eafc2fdc1367', 'request_id': 'req-f7f585b5-6ff3-46e6-b51c-886e4354b10f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:28.251915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] The token cache is being invalidate because project ce04388a7dc74e2185b4eafc2fdc1367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:22:28.252227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:28.252862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f7f585b5-6ff3-46e6-b51c-886e4354b10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:28.254837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1207/2390] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:22:28 2022] DELETE /identity/v3/projects/ce04388a7dc74e2185b4eafc2fdc1367 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:28.259744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.260032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.260305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.280175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:28.281434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:28.347309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1184/2391] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:22:28.354963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.355245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.355532 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.374886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:28.376111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:28.384259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1208/2392] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:28.388879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.398598 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c3358-d1b0-4106-b255-019a83541b90 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.403385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.404554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.404842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.405116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.405874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:22:28.406180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.407780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.421514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1185/2393] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:22:28.425050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.434210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705d1c3-8880-4de7-bb4c-a2da74f74f5b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.441189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.441908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.442186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.442457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.443150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.445487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.489443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1209/2394] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:22:28 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:22:28.491226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.501476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6e614-c684-4596-bbed-8a0dfc3e08d8 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.599060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.599741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.600028 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.600305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.600999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.602977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.625955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1186/2395] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:22:28 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:22:28.630006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.641809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d420-a862-4308-a8d1-a0ae3ebb8466 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.646746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.647894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.648253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.648603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.649459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.651197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.664704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1210/2396] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:22:28.668894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.680545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b15e6-f99a-42f0-9df1-05079220ad4d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.685536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.686299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.686661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.687006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.687822 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.689721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a7eff-c5f7-42d7-880a-742bcaf08ce1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.701248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1187/2397] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:22:28.705050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.715344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530f515-4580-49c0-9ff6-2fa35e03f37c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.726668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.727577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.727854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.728129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] PATH_INFO: `/v3/projects/3d7565436d024c8486ead89083dc7390/users/e34b02b5d28e4bdb89aff2fa981531c0/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.746064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7565436d024c8486ead89083dc7390, user_id=e34b02b5d28e4bdb89aff2fa981531c0, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.750560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.777929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1211/2398] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:22:28 2022] PUT /identity/v3/projects/3d7565436d024c8486ead89083dc7390/users/e34b02b5d28e4bdb89aff2fa981531c0/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:22:28.783211 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.783515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.783801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.822639 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] MFA Rules not processed for user `e34b02b5d28e4bdb89aff2fa981531c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:28.823892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:28.896898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1188/2399] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:28.904440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:28.906416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:28.970938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f66551-cd93-4210-9a2c-aaf3d917140c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:28.976164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:28.977086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:28.977470 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:28.977809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:28.987094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:28.988562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f997b8-67a1-4f2b-8438-c232629b92ce service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:28.997352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1212/2400] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:49.421682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:49.480895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74777b-8926-40ca-ac47-cf6e0f542e70 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:49.485544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:49.486401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:49.486682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:49.486955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] PATH_INFO: `/v3/users/e34b02b5d28e4bdb89aff2fa981531c0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:49.488118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34b02b5d28e4bdb89aff2fa981531c0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:49.490075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:49.533618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34b02b5d28e4bdb89aff2fa981531c0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:49.540658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34b02b5d28e4bdb89aff2fa981531c0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:49.547162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34b02b5d28e4bdb89aff2fa981531c0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:49.547775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34b02b5d28e4bdb89aff2fa981531c0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:49.548371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34b02b5d28e4bdb89aff2fa981531c0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:49.564862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1189/2401] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:22:49 2022] DELETE /identity/v3/users/e34b02b5d28e4bdb89aff2fa981531c0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:49.569266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:49.569760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:49.569978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:49.586759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:49.587965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:49.645431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1213/2402] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:49.658218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:49.659529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:49.716217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0689d-e808-44d4-b5e7-535a6efa6caa admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:49.720404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:49.721042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:49.721386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:49.721662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:49.730643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:49.732073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c688-b5d3-41e2-a9d1-1b146fea3e44 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:49.741401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1190/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:22:50.036377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:50.038233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:50.063244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc75673-094a-4cec-aceb-7b14262d5f34 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:50.070108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:50.070981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:50.071262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:50.071539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] PATH_INFO: `/v3/projects/3d7565436d024c8486ead89083dc7390` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:50.072749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7565436d024c8486ead89083dc7390)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:50.074784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:50.120072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7565436d024c8486ead89083dc7390', 'request_id': 'req-196208e7-1a63-4141-94a2-5f5c58dacff0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:50.126481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7565436d024c8486ead89083dc7390', 'request_id': 'req-196208e7-1a63-4141-94a2-5f5c58dacff0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:50.131857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7565436d024c8486ead89083dc7390', 'request_id': 'req-196208e7-1a63-4141-94a2-5f5c58dacff0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:50.144605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] The token cache is being invalidate because project 3d7565436d024c8486ead89083dc7390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:22:50.144897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:50.145541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:22:50.147689 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1214/2404] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:22:50 2022] DELETE /identity/v3/projects/3d7565436d024c8486ead89083dc7390 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:22:52.422640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871d17-0ec5-48d8-aa37-10622356b8a9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:52.423118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871d17-0ec5-48d8-aa37-10622356b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:52.423310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1871d17-0ec5-48d8-aa37-10622356b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:52.439923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f1871d17-0ec5-48d8-aa37-10622356b8a9 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:22:52.441136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f1871d17-0ec5-48d8-aa37-10622356b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:52.497165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1191/2405] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:22:52.509411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:22:52.510816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:22:52.577399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196208e7-1a63-4141-94a2-5f5c58dacff0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:22:52.582506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:22:52.583147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:22:52.583430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:22:52.583704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:22:52.591556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:22:52.593771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:22:52.601610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1215/2406] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:23:22.123911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:23:22.124454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:23:22.124454 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:23:22.142502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] MFA Rules not processed for user `6d960067f49b43a7bd26af6c0a20d369`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:23:22.143683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:23:22.195574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1192/2407] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:23:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:23:44.254855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:23:44.256312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:23:44.319234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cd5c5-1430-411b-bc2e-6995e4668d00 service swift] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:23:44.323679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:23:44.324529 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:23:44.324806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:23:44.325078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] PATH_INFO: `/v3/users/11db1721d8a644dba09708e4feb4edd0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:23:44.326277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11db1721d8a644dba09708e4feb4edd0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:23:44.328196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:23:44.372102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11db1721d8a644dba09708e4feb4edd0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.378710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11db1721d8a644dba09708e4feb4edd0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.385402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11db1721d8a644dba09708e4feb4edd0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.386019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11db1721d8a644dba09708e4feb4edd0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.397724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-20592e19-251e-4aa3-8a53-15b8b1329212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11db1721d8a644dba09708e4feb4edd0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.403534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1216/2408] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:23:44 2022] DELETE /identity/v3/users/11db1721d8a644dba09708e4feb4edd0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:23:44.574071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:23:44.589067 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cc573-697e-46fa-9284-4392c6f2dacc None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:23:44.644290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:23:44.645232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:23:44.645612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:23:44.645890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] PATH_INFO: `/v3/projects/7e62e10833584bf2aa6bed03b41ba89a` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:23:44.647110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e62e10833584bf2aa6bed03b41ba89a)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:23:44.649002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:23:44.693433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e62e10833584bf2aa6bed03b41ba89a', 'request_id': 'req-50bda5cb-aa52-45ed-a9e6-77a0536263f0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.698560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e62e10833584bf2aa6bed03b41ba89a', 'request_id': 'req-50bda5cb-aa52-45ed-a9e6-77a0536263f0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.705903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e62e10833584bf2aa6bed03b41ba89a', 'request_id': 'req-50bda5cb-aa52-45ed-a9e6-77a0536263f0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.716302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] The token cache is being invalidate because project 7e62e10833584bf2aa6bed03b41ba89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:23:44.716583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.717186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:23:44.718716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1193/2409] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:23:44 2022] DELETE /identity/v3/projects/7e62e10833584bf2aa6bed03b41ba89a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:23:53.997913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:23:53.998418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:23:53.998514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:23:54.015808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] MFA Rules not processed for user `3d32a8df74c74851adf017d2132ad13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:23:54.017037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:23:54.070549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1217/2410] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:23:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:07.462816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:07.464376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:07.520343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda5cb-aa52-45ed-a9e6-77a0536263f0 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:07.523877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:07.524506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:07.524787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:07.525058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:07.526855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:07.593387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:07.594852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:07.605374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1194/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:10.567550 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:10.568898 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:10.625109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230328cc-048b-45e2-9354-a6c5614af1cb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:10.629377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:10.630056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:10.630339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:10.630616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:10.632450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:10.647116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:10.648562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:10.659524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1218/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:20.938175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:20.940182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:20.951350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:20.951879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8c53-14ac-4ae3-b964-1051c316872b service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:20.956648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:20.957456 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:20.957769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:20.958166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:20.960102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:20.961635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd72bf-157d-4869-8a5c-409e950784da service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:20.967009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:20.967784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:20.968075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:20.968342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:20.971282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:21.027083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:21.028687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5e8ce-75b5-473c-8c30-06fc3079439a service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:21.034728 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:21.036182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:21.038569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1195/2413] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:21.045304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1219/2414] 10.222.0.13 () {60 vars in 1396 bytes} [Mon May 16 22:24:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:21.454972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:21.455337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:21.455697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:21.457877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:21.459509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:21.475972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:21.477193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:21.478070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec73e3-8e48-4838-8fd7-fdf8261e8001 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:21.485258 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:21.485914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:21.486219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:21.486631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:21.488412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:21.536196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1196/2415] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:24:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:21.557731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:21.559591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759000bf-e0e3-45e0-9189-24aa2e3fe0a1 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:21.570139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1220/2416] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:21.593820 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:21.596036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:21.675930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc405-e984-4e72-b7b3-0e16c939d815 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:21.682468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:21.683204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:21.683562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:21.683913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:21.693993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:21.695685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:21.705086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1197/2417] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:24:25.748207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9154a-ae47-4087-898b-998a4c09afd4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:25.748737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9154a-ae47-4087-898b-998a4c09afd4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:25.748899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9154a-ae47-4087-898b-998a4c09afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:25.768883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-35c9154a-ae47-4087-898b-998a4c09afd4 None None] MFA Rules not processed for user `de089161e46349db878d6d12d1fc3d42`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:25.770169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-35c9154a-ae47-4087-898b-998a4c09afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:25.781803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1221/2418] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:26.135570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:26.148624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa688e4-6989-4354-95b7-0b8b440ecc4f service swift] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:26.155241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:26.157428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:26.157952 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:26.158905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:26.161355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:26.174356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:26.175833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d08c9-a1a0-4937-878d-f3080012a41d service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:26.193420 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1198/2419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:26.533328 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1322ee-28e7-4864-989c-eba3f081d635 None None] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:26.534006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1322ee-28e7-4864-989c-eba3f081d635 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:26.534459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1322ee-28e7-4864-989c-eba3f081d635 None None] PATH_INFO: `/` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:26.536677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1222/2420] 10.222.0.13 () {54 vars in 960 bytes} [Mon May 16 22:24:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 22:24:26.550727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:26.551036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:26.551301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:26.610750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] MFA Rules not processed for user `6701f4de739740c080f6abec278ae940`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:26.611888 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:26.682833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1199/2421] 10.222.0.13 () {58 vars in 1057 bytes} [Mon May 16 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:26.691279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1322ee-28e7-4864-989c-eba3f081d635 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:26.704438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1322ee-28e7-4864-989c-eba3f081d635 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:26.709661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:26.710398 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:26.710773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:26.711121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:26.712971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:26.725012 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:26.726679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:26.737420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1223/2422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:29.068065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:29.079723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d117-657b-4b04-b3c8-e801dd6f2c1e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:29.083678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:29.084527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:29.084967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:29.085417 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:29.087443 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:29.099532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:29.105605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:29.123496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1200/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:31.064866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:31.066424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:31.130481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f3da2-6dca-450a-b436-c55ffcb202b6 service placement] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:31.134976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:31.135830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:31.136112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:31.136386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] PATH_INFO: `/v3/users/376c54b9ed1b447bb60e4eafb246774d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:31.137824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] RBAC: Authorizing `identity:delete_user(user_id=376c54b9ed1b447bb60e4eafb246774d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:31.139745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:31.184610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376c54b9ed1b447bb60e4eafb246774d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.192567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376c54b9ed1b447bb60e4eafb246774d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.199338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376c54b9ed1b447bb60e4eafb246774d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.199971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376c54b9ed1b447bb60e4eafb246774d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.211065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376c54b9ed1b447bb60e4eafb246774d'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.216711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1224/2424] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:24:31 2022] DELETE /identity/v3/users/376c54b9ed1b447bb60e4eafb246774d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:31.390716 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:31.402108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18029e91-b564-47bc-9685-dbb5944cc47c service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:31.458922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:31.459793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:31.460073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:31.460348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] PATH_INFO: `/v3/projects/f1ae04ae72524cad8df7d557c2db1755` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:31.461603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ae04ae72524cad8df7d557c2db1755)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:31.463512 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:31.511026 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ae04ae72524cad8df7d557c2db1755', 'request_id': 'req-6bdfde08-c734-4e29-9c71-1da5863a7dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.516628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ae04ae72524cad8df7d557c2db1755', 'request_id': 'req-6bdfde08-c734-4e29-9c71-1da5863a7dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.524667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ae04ae72524cad8df7d557c2db1755', 'request_id': 'req-6bdfde08-c734-4e29-9c71-1da5863a7dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.536169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] The token cache is being invalidate because project f1ae04ae72524cad8df7d557c2db1755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:24:31.536460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.537111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.538667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1201/2425] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:24:31 2022] DELETE /identity/v3/projects/f1ae04ae72524cad8df7d557c2db1755 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:31.542577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:31.543971 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:31.557592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c230-aeb3-4570-a550-ed7312f3203f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:31.613122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:31.614023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:31.614300 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:31.614572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] PATH_INFO: `/v3/users/c1fd8af095b3490fa4a4774e5a9b86bb` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:31.615740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fd8af095b3490fa4a4774e5a9b86bb)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:31.617705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:31.661145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fd8af095b3490fa4a4774e5a9b86bb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.667813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fd8af095b3490fa4a4774e5a9b86bb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.675054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fd8af095b3490fa4a4774e5a9b86bb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.675665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fd8af095b3490fa4a4774e5a9b86bb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.686878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fd8af095b3490fa4a4774e5a9b86bb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.692801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1225/2426] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:24:31 2022] DELETE /identity/v3/users/c1fd8af095b3490fa4a4774e5a9b86bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:31.860450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:31.861923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:31.874589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfde08-c734-4e29-9c71-1da5863a7dd4 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:31.930307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:31.931157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:31.931429 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:31.931695 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] PATH_INFO: `/v3/projects/d24f7d234fe34efe87983225b2a12243` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:31.932849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24f7d234fe34efe87983225b2a12243)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:31.934791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:31.978606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24f7d234fe34efe87983225b2a12243', 'request_id': 'req-2e72270b-d515-45fe-b4df-e2673946171a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.983833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24f7d234fe34efe87983225b2a12243', 'request_id': 'req-2e72270b-d515-45fe-b4df-e2673946171a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:31.991081 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24f7d234fe34efe87983225b2a12243', 'request_id': 'req-2e72270b-d515-45fe-b4df-e2673946171a'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:32.001622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] The token cache is being invalidate because project d24f7d234fe34efe87983225b2a12243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:24:32.001912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:32.002539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:32.004048 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1202/2427] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:24:31 2022] DELETE /identity/v3/projects/d24f7d234fe34efe87983225b2a12243 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:33.528496 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:33.529955 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:33.600577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aab98-c9e8-4df9-9dcb-a0ff4e3343f0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:33.659588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:33.660234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:33.660520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:33.660796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:33.662784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:33.674593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:33.676172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:33.686321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1226/2428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:35.577361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:35.578746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:35.633446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72270b-d515-45fe-b4df-e2673946171a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:35.636980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:35.637906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:35.638188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:35.638462 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:35.640183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:35.700457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:35.701921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:35.711296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1203/2429] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:39.068227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.069706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:39.083944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d00ff-2066-48d0-b5cd-7798ea353449 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.088694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.089579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.089863 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.090136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] PATH_INFO: `/v3/users/6d960067f49b43a7bd26af6c0a20d369` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.091304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d960067f49b43a7bd26af6c0a20d369)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.093372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.137144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d960067f49b43a7bd26af6c0a20d369'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.144466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d960067f49b43a7bd26af6c0a20d369'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.151142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d960067f49b43a7bd26af6c0a20d369'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.151818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d960067f49b43a7bd26af6c0a20d369'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.163008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4d75b7db-e925-4b7c-b7ed-4209ce5e2682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d960067f49b43a7bd26af6c0a20d369'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.168582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1227/2430] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:24:39 2022] DELETE /identity/v3/users/6d960067f49b43a7bd26af6c0a20d369 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:39.329444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.339268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c2be2-66ee-4e5e-87cf-6b8ae66c8474 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.399909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.400802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.401080 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.401396 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] PATH_INFO: `/v3/projects/b4b0e4ddef624ac4b91c44d0c6154da7` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.402570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b0e4ddef624ac4b91c44d0c6154da7)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.404482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.455616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'request_id': 'req-5b82a4d6-fdbc-49d3-a879-acf96d972dca'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.460666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'request_id': 'req-5b82a4d6-fdbc-49d3-a879-acf96d972dca'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.468355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b0e4ddef624ac4b91c44d0c6154da7', 'request_id': 'req-5b82a4d6-fdbc-49d3-a879-acf96d972dca'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.478831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] The token cache is being invalidate because project b4b0e4ddef624ac4b91c44d0c6154da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:24:39.479115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.479723 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5b82a4d6-fdbc-49d3-a879-acf96d972dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:24:39.481243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1204/2431] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:24:39 2022] DELETE /identity/v3/projects/b4b0e4ddef624ac4b91c44d0c6154da7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:39.486785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.487078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.487355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.505355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:39.506544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:39.562048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1228/2432] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:39.570330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.570623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.570897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.589057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:39.590286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:39.598800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1205/2433] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:39.602878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.612938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aa906-a9eb-4a92-af90-d2335385c121 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.617486 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.618134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.618412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.618683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.619399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:24:39.619702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.621312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.632280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1229/2434] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:24:39.636313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.645706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78bfef-56eb-40a1-a1dc-29b74ad89969 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.650313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.650944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.651225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.651496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.652179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.654110 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.678961 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1206/2435] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:24:39 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:24:39.682851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.692554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424b990-48c4-41b4-b3ad-b52ad08d6dd6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.746040 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.746630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.746911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.747186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.747868 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.749819 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.769150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1230/2436] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:24:39 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:24:39.773229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.783885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a2b74-ad2f-4e69-b1a2-39c7cbdcdd32 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.788365 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.789012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.789316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.789590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.790304 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.791889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.803164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1207/2437] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:24:39.806947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.816708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c77cd-5ed6-41e0-ba79-1a7728ca7e5c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.821224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.821888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.822168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.822443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.823159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.824741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2e203-f4d9-4902-9951-a9535392f793 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.835045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1231/2438] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:24:39.839098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.849516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ac45f-677d-4f0d-8a25-1be8dcd9d27c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:39.854140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:39.855007 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.855288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.855559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] PATH_INFO: `/v3/projects/1fdb1e1a694045db8aba7380ea8d66f6/users/e9e915bc5c604cfcb8662167332f6dbc/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.870149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdb1e1a694045db8aba7380ea8d66f6, user_id=e9e915bc5c604cfcb8662167332f6dbc, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:39.872819 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:39.884925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1208/2439] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:24:39 2022] PUT /identity/v3/projects/1fdb1e1a694045db8aba7380ea8d66f6/users/e9e915bc5c604cfcb8662167332f6dbc/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:24:39.890327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1394f-26cd-4f7f-ae0d-b6a4c0332319 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:39.890639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1394f-26cd-4f7f-ae0d-b6a4c0332319 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:39.890919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1394f-26cd-4f7f-ae0d-b6a4c0332319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:39.907847 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9ba1394f-26cd-4f7f-ae0d-b6a4c0332319 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:39.909046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9ba1394f-26cd-4f7f-ae0d-b6a4c0332319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:39.966037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1232/2440] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:39.976447 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:39.978223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:40.038195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c79-b1ad-4d43-b8f1-69168bf142b7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:40.041851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:40.042496 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:40.042778 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:40.043054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:40.052265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:40.053749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:40.063749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1209/2441] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:44.575164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652053-4d9b-4da5-a9c7-b7f821e155cc None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:44.576410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652053-4d9b-4da5-a9c7-b7f821e155cc None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:44.576909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7652053-4d9b-4da5-a9c7-b7f821e155cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:44.611503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d7652053-4d9b-4da5-a9c7-b7f821e155cc None None] MFA Rules not processed for user `e9e915bc5c604cfcb8662167332f6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:44.612738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d7652053-4d9b-4da5-a9c7-b7f821e155cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:44.684322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1233/2442] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:44.699128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:44.700570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:44.775350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13cdf-39d0-4650-bbdf-caf7f3765a7e service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:44.781300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:44.781962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:44.782247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:44.782527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:44.790777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:44.792363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:44.801520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1210/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:46.033068 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:46.033623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:46.033733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:46.051482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] MFA Rules not processed for user `e9e915bc5c604cfcb8662167332f6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:46.052788 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:46.059931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1234/2444] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:46.403640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:46.415738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdebbf-e7c8-4332-9296-4f8f997f2e71 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:46.420331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:46.421530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:46.421827 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:46.422320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:46.424247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:46.434416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:46.435859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:46.444753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1211/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:49.804792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:49.812265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:49.852464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382d2c3-0ad4-44df-9e58-be5c8966a804 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:49.859790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:49.860441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:49.860877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:49.861165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:49.863287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:49.973927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:49.976410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825d9fa-63fc-4972-8ae4-718d06c74aa6 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:49.991005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1235/2446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:24:50.895293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:50.924609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8d567-e54e-43b8-b8c1-cbd40907fc3e service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:50.931379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:50.932267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:50.932714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:50.933142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:50.935278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:50.966654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:50.969036 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:50.984865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1212/2447] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:24:51.786792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bf62-56cc-4bdc-b7b4-57246f764b02 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:51.787246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bf62-56cc-4bdc-b7b4-57246f764b02 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:51.787343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bf62-56cc-4bdc-b7b4-57246f764b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:51.804184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-5426bf62-56cc-4bdc-b7b4-57246f764b02 None None] MFA Rules not processed for user `2b7f4e19dcdf475bb44bb51597281a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:24:51.805428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5426bf62-56cc-4bdc-b7b4-57246f764b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:51.858604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1236/2448] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:24:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:24:56.535251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:24:56.547338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4db15-f80d-41fe-9153-c2675495f5d5 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:24:56.552858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:24:56.553564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:24:56.553845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:24:56.554128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:24:56.555964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:24:56.568953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:24:56.570578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:24:56.580901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1213/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:24:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:25:06.142009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53930d7-694d-4d14-8012-3fbe0e0028f1 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:06.142489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53930d7-694d-4d14-8012-3fbe0e0028f1 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:06.142591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53930d7-694d-4d14-8012-3fbe0e0028f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:06.160694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c53930d7-694d-4d14-8012-3fbe0e0028f1 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:06.161930 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c53930d7-694d-4d14-8012-3fbe0e0028f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:06.215561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1237/2450] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:25:06.228054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:06.229470 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:06.294095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d99b2-566b-412b-b276-65b413db66e9 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:06.299003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:06.299633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:06.299908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:06.300176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:06.307879 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:06.309464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:06.317296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1214/2451] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:25:21.972937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b733a-4213-4bec-83fb-f2596dd2a85f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:21.973495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b733a-4213-4bec-83fb-f2596dd2a85f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:21.973588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b733a-4213-4bec-83fb-f2596dd2a85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:21.992731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b39b733a-4213-4bec-83fb-f2596dd2a85f None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:21.994163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b39b733a-4213-4bec-83fb-f2596dd2a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:22.001338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1238/2452] 10.222.0.13 () {58 vars in 1009 bytes} [Mon May 16 22:25:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:25:22.023022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:22.034386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf2c40-8300-491f-aaed-e3bbe9961d87 service swift] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:22.039316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:22.039940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:22.040220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:22.040491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:22.048273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:22.049889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:22.057913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1215/2453] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:25:38.121053 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:38.121581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:38.121674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:38.139206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] MFA Rules not processed for user `a459163f5d714b3f92b6e90e75deb308`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:38.140397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:38.147471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1239/2454] 10.222.0.13 () {58 vars in 967 bytes} [Mon May 16 22:25:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:25:38.159875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:38.170079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e0f7-71fa-4168-87de-afa36d4cdcb3 service swift] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:38.175609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd51afc0a8e1949fb8d3e346a97c56ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:38.176231 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:38.176537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:38.176809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:38.184536 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:38.186128 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af970c-d4f3-4468-b961-c9587e3e612f service swift] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:38.194227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1216/2455] 10.222.0.13 () {60 vars in 1384 bytes} [Mon May 16 22:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 22:25:52.058561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:52.060000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:52.071807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0ff9e-0d00-416b-aa26-7d0b59ddfe15 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:52.075484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:52.076126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:52.076410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:52.076687 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:52.078498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:52.091873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:52.093343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:52.111684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1240/2456] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:25:53.481190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:53.482064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:53.482369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:53.500476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] MFA Rules not processed for user `e9e915bc5c604cfcb8662167332f6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:53.501931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:53.509620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1217/2457] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:25:55.160348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:55.162970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:55.184011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef410-6b16-4c68-9961-22dcb349263b service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:55.191433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:55.192942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.193296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.193539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] PATH_INFO: `/v3/users/de089161e46349db878d6d12d1fc3d42` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.194926 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de089161e46349db878d6d12d1fc3d42)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:55.198054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:55.277814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de089161e46349db878d6d12d1fc3d42'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.285627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de089161e46349db878d6d12d1fc3d42'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.294403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de089161e46349db878d6d12d1fc3d42'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.295221 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de089161e46349db878d6d12d1fc3d42'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.309717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-992b43da-758a-4b78-96c9-209b208e032a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de089161e46349db878d6d12d1fc3d42'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.316455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1241/2458] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:25:55 2022] DELETE /identity/v3/users/de089161e46349db878d6d12d1fc3d42 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:25:55.521795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:55.539386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc034d1-8222-4d9c-8246-cf50acc0b938 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:55.604944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:55.605834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.606114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.606391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] PATH_INFO: `/v3/projects/dd543ac61ee64797b43e960f4ddec858` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.607553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd543ac61ee64797b43e960f4ddec858)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:55.609483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:55.655209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd543ac61ee64797b43e960f4ddec858', 'request_id': 'req-ac66f071-8bae-4963-b2ca-747c6a5e7639'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.660451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd543ac61ee64797b43e960f4ddec858', 'request_id': 'req-ac66f071-8bae-4963-b2ca-747c6a5e7639'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.668174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd543ac61ee64797b43e960f4ddec858', 'request_id': 'req-ac66f071-8bae-4963-b2ca-747c6a5e7639'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.679690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] The token cache is being invalidate because project dd543ac61ee64797b43e960f4ddec858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:25:55.679979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.680606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac66f071-8bae-4963-b2ca-747c6a5e7639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:25:55.682412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1218/2459] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:25:55 2022] DELETE /identity/v3/projects/dd543ac61ee64797b43e960f4ddec858 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:25:55.687545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.687817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.688097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.708659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:55.709909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:55.767964 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1242/2460] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:25:55.776011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.776331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.776609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.794923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:55.796360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:55.807590 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1219/2461] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:25:55.811917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:55.822621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ce36-01cb-42a4-98c0-927b9ffa50df None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:55.827315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:55.827970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.828264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.828537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.829305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:25:55.829616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:55.831228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:55.848514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1243/2462] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:25:55.854807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:55.864897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78177b0d-fd58-447e-9eed-8a7296291518 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:55.869878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:55.870533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.870818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.871094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.871790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:55.873753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:55.913393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1220/2463] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:25:55 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:25:55.914615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:55.925418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24913-6092-461d-86c4-fe8b3447f07e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:55.985629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:55.986305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:55.986586 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:55.986864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:55.987564 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:55.989549 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.016742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1244/2464] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:25:55 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:25:56.018704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.030858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106664f-b06a-4492-abcf-1e81944869ac admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.038060 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.038756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.039043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.039324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.040056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.041761 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.053058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1221/2465] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:25:56.057107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.068329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a08e46-59a5-4eb7-a027-752289affe0c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.075187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.076166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.076459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.076736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.077516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.079461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201d91c-0782-4d0d-a3c7-8eb316337b2c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.090129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1245/2466] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:25:56.094825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.105727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd03f8-f561-41d1-a442-94e3e074d8dd admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.113009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.114351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.114485 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.114776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] PATH_INFO: `/v3/projects/75669e797d6d48c7ad8ba1b41ac3f7ff/users/767d236d4c654f27a53db9f8d4ca0366/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.134486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75669e797d6d48c7ad8ba1b41ac3f7ff, user_id=767d236d4c654f27a53db9f8d4ca0366, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.137196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.159836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1222/2467] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:25:56 2022] PUT /identity/v3/projects/75669e797d6d48c7ad8ba1b41ac3f7ff/users/767d236d4c654f27a53db9f8d4ca0366/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:25:56.170820 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.171379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.173430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.204882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] MFA Rules not processed for user `767d236d4c654f27a53db9f8d4ca0366`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:56.206179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:56.278871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1246/2468] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:25:56.283896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.346941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ac31c-3983-4279-9b11-53bc45917859 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.351648 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.352308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.352595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.352869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.353601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.355502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.388187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1223/2469] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:25:56 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:25:56.389457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.401164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2733191-a778-449d-af3c-534c8f04ce64 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.457986 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.458761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.459128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.459411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.460102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.462269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.487125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1247/2470] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:25:56 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:25:56.493910 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.510127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8977-3537-4181-a3b8-3869a33830b4 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.518800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.518800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.518800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.518800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.519294 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.520774 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.532964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1224/2471] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:25:56.537174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.547963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7a23a-953a-40e9-88e4-9c06a5d4f9ab admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.554732 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.555636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.555920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.556372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] PATH_INFO: `/v3/projects/41675fd1fa994ef9a74e8227940d182b/users/8890b3080c504ebe9d6f394978ce2c4f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.572441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=41675fd1fa994ef9a74e8227940d182b, user_id=8890b3080c504ebe9d6f394978ce2c4f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.575457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.590762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1248/2472] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:25:56 2022] PUT /identity/v3/projects/41675fd1fa994ef9a74e8227940d182b/users/8890b3080c504ebe9d6f394978ce2c4f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:25:56.595592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.609599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175735f-38f5-41d2-946a-d6e1054cd423 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.670927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.671620 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.671896 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.672166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.673093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.674734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bdb6d-4672-44c5-a724-081b0620dbc3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.684572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1225/2473] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:25:56.689104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.700595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03cfb5-f050-45ab-b79a-83aae63ecbdd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.707056 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.708025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.708332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.708697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] PATH_INFO: `/v3/projects/41675fd1fa994ef9a74e8227940d182b/users/8890b3080c504ebe9d6f394978ce2c4f/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.710784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41675fd1fa994ef9a74e8227940d182b, user_id=8890b3080c504ebe9d6f394978ce2c4f, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.713665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.724975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1249/2474] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:25:56 2022] PUT /identity/v3/projects/41675fd1fa994ef9a74e8227940d182b/users/8890b3080c504ebe9d6f394978ce2c4f/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:25:56.736240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.736240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.736542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.789816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] MFA Rules not processed for user `8890b3080c504ebe9d6f394978ce2c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:25:56.791174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:56.873713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1226/2475] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:25:56.885233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:56.887037 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:25:56.947022 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fee2d-fe37-4d08-a2f9-90168fbf89e8 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:56.950656 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:56.951311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:56.951597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:56.951873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:56.961427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:56.962879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:56.973145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1250/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:25:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:25:57.050564 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:25:57.060154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e31a1-be38-49f3-bc09-b1e60fe57082 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:25:57.065900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:25:57.066549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:25:57.066834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:25:57.067111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:25:57.125063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:25:57.127066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2613919-c901-46b7-9471-3b990e2c10ec service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:25:57.135814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1227/2477] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:06.245108 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:06.306968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bfae-d612-4f52-904d-b85a003905c9 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:06.311488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:06.312348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:06.312633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:06.312928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] PATH_INFO: `/v3/users/767d236d4c654f27a53db9f8d4ca0366` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:06.314720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=767d236d4c654f27a53db9f8d4ca0366)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:06.316823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:06.363112 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767d236d4c654f27a53db9f8d4ca0366'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.369635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767d236d4c654f27a53db9f8d4ca0366'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.377420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767d236d4c654f27a53db9f8d4ca0366'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.378038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767d236d4c654f27a53db9f8d4ca0366'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.389738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767d236d4c654f27a53db9f8d4ca0366'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.395781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1251/2478] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:06 2022] DELETE /identity/v3/users/767d236d4c654f27a53db9f8d4ca0366 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:06.400538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:06.401039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:06.401154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:06.419908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:06.421123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:06.480555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1228/2479] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:06.491597 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:06.492998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:06.547679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36207d4f-2741-4c12-ad76-1cc402dba27d admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:06.552070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:06.552710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:06.552990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:06.553291 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:06.562165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:06.563592 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:06.573194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1252/2480] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:06.833869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:06.835302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:06.852787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da17256-cd56-44a4-89fc-3fa2d3af47f5 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:06.863871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:06.864738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:06.865016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:06.865318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] PATH_INFO: `/v3/projects/75669e797d6d48c7ad8ba1b41ac3f7ff` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:06.867389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75669e797d6d48c7ad8ba1b41ac3f7ff)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:06.869515 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:06.917494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75669e797d6d48c7ad8ba1b41ac3f7ff', 'request_id': 'req-8344a979-04ba-4a99-b0d2-a209c2bc1275'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.922807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75669e797d6d48c7ad8ba1b41ac3f7ff', 'request_id': 'req-8344a979-04ba-4a99-b0d2-a209c2bc1275'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.929371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75669e797d6d48c7ad8ba1b41ac3f7ff', 'request_id': 'req-8344a979-04ba-4a99-b0d2-a209c2bc1275'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.939846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] The token cache is being invalidate because project 75669e797d6d48c7ad8ba1b41ac3f7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:06.940132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.940752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:06.942315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1229/2481] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:06 2022] DELETE /identity/v3/projects/75669e797d6d48c7ad8ba1b41ac3f7ff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:06.946317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:06.956242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83b17-9d49-4b2f-9a00-e6c9574aec97 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.013110 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.014030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.014311 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.014590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] PATH_INFO: `/v3/users/8890b3080c504ebe9d6f394978ce2c4f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.015828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8890b3080c504ebe9d6f394978ce2c4f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.018591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.064957 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8890b3080c504ebe9d6f394978ce2c4f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.071963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8890b3080c504ebe9d6f394978ce2c4f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.079475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8890b3080c504ebe9d6f394978ce2c4f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.081249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8890b3080c504ebe9d6f394978ce2c4f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.093437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-409ca4e9-d1ae-4e6a-9211-95ad2366f518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8890b3080c504ebe9d6f394978ce2c4f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.103287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1253/2482] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:06 2022] DELETE /identity/v3/users/8890b3080c504ebe9d6f394978ce2c4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:07.363667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.365160 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:07.378492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344a979-04ba-4a99-b0d2-a209c2bc1275 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.432845 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.433730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.434006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.434272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] PATH_INFO: `/v3/projects/41675fd1fa994ef9a74e8227940d182b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.435430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41675fd1fa994ef9a74e8227940d182b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.437354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.481409 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41675fd1fa994ef9a74e8227940d182b', 'request_id': 'req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.486571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41675fd1fa994ef9a74e8227940d182b', 'request_id': 'req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.493519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41675fd1fa994ef9a74e8227940d182b', 'request_id': 'req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.505300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] The token cache is being invalidate because project 41675fd1fa994ef9a74e8227940d182b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:07.505849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.506684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ce47f32e-48ae-4f4b-ad4c-2fa9be7a5ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:07.508555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1230/2483] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:07 2022] DELETE /identity/v3/projects/41675fd1fa994ef9a74e8227940d182b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:07.513825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.514320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.514522 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.532775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:07.534006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:07.589828 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1254/2484] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:07.597305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.597600 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.597878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.615987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:07.617386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:07.625111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1231/2485] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:07.629807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.639878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ab3b-2461-4603-9fd2-c5fd37eeddf7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.644509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.645155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.645465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.645738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.646480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:07.646809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.648400 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.659716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1255/2486] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:07.663851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.672719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190671d1-cc83-4b1d-a3c8-6c33df511273 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.677973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.678604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.678883 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.679154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.679826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.681753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.706360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1232/2487] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:07 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:07.710406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.720392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a9d38-4ae8-4649-84a1-1aae0b5a4f49 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.775116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.775700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.775981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.776254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.776927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.778874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.801365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1256/2488] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:07 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:07.802531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.812622 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142864-faff-43b9-bd88-2065c6900ecf admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.817754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.818403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.818682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.818950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.819711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.821322 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.831148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1233/2489] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:26:07.835146 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.844817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a52868-1e6a-4555-baba-430e42d66f7f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.849434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.850072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.850350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.850620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.851334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.852918 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449edd0-f745-45f6-9f4c-184caf80477b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.863010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1257/2490] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:07.866997 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:07.877441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eee92-69bf-4b34-a3d7-a6b9f0fa3bae admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:07.882083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:07.882977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.883251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.883516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] PATH_INFO: `/v3/projects/784297060cdb4a689d02c0a23d3586a4/users/c02d7477545f4f3eaec5ff4b2b782f90/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.898299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784297060cdb4a689d02c0a23d3586a4, user_id=c02d7477545f4f3eaec5ff4b2b782f90, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:07.900943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:07.914016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1234/2491] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:07 2022] PUT /identity/v3/projects/784297060cdb4a689d02c0a23d3586a4/users/c02d7477545f4f3eaec5ff4b2b782f90/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:07.925433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:07.925725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:07.926001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:07.951748 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] MFA Rules not processed for user `c02d7477545f4f3eaec5ff4b2b782f90`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:07.953020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:08.013622 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1258/2492] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:08.018612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.076663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3c716-8b02-48c3-8666-930e99f76706 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.081867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.082526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.082807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.083085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.083771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.085725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.109540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1235/2493] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:08 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:08.113655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.124118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e453e7-7b5a-46e3-abbf-95e61068c1d6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.178896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.179569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.179870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.180144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.180938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.182976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.203891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1259/2494] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:08 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:08.209355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.220452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dae65-56b2-471c-825e-4aeb7d1d7e15 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.225335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.226221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.226572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.226915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.227704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.229403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.240179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1236/2495] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:08.244072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.254536 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86543a03-f2b5-46b9-8989-849c2e6b5010 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.259354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.260320 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.260677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.261024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] PATH_INFO: `/v3/projects/963edab66f074af8894c4858cfb4906a/users/9a55cf2395dc4ea8bf3a4cef14b448ae/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.276569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963edab66f074af8894c4858cfb4906a, user_id=9a55cf2395dc4ea8bf3a4cef14b448ae, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.279401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.292897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1260/2496] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:08 2022] PUT /identity/v3/projects/963edab66f074af8894c4858cfb4906a/users/9a55cf2395dc4ea8bf3a4cef14b448ae/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:08.296659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.306433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8896e-b067-4e81-9a06-3a14c41d83a6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.362482 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.363064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.363347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.363619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.364336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.365962 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba4edc-6928-4cdc-a955-81b7c2c656e0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.375968 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1237/2497] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:08.380693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.391487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370c3b-2fa8-4282-b634-2120c0b64381 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.396212 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.397098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.397415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.397699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] PATH_INFO: `/v3/projects/963edab66f074af8894c4858cfb4906a/users/9a55cf2395dc4ea8bf3a4cef14b448ae/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.399734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=963edab66f074af8894c4858cfb4906a, user_id=9a55cf2395dc4ea8bf3a4cef14b448ae, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.402458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.412884 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1261/2498] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:08 2022] PUT /identity/v3/projects/963edab66f074af8894c4858cfb4906a/users/9a55cf2395dc4ea8bf3a4cef14b448ae/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:08.423035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.423830 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.424111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.451806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] MFA Rules not processed for user `9a55cf2395dc4ea8bf3a4cef14b448ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:08.453017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:08.517859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1238/2499] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:08.529477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.531384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:08.587795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1a57f-1431-4213-a932-1715083c2766 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.591524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.592164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.592445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.592720 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.601585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.603025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.612838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1262/2500] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:26:08.685661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:08.695685 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da090e-a1bc-4d7e-8f03-cfe6ce1c68b7 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:08.699387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:08.700052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:08.700336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:08.700609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:08.755966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:08.757423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354804a-d4ff-406b-bee3-fd424054baad service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:08.766499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1239/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:11.463244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:11.523129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5affbc-effc-4794-a0cb-494437e326e2 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:11.527639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:11.528491 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:11.528770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:11.529039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] PATH_INFO: `/v3/users/c02d7477545f4f3eaec5ff4b2b782f90` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:11.530253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02d7477545f4f3eaec5ff4b2b782f90)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:11.532228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:11.576047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02d7477545f4f3eaec5ff4b2b782f90'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:11.583050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02d7477545f4f3eaec5ff4b2b782f90'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:11.589710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02d7477545f4f3eaec5ff4b2b782f90'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:11.590309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02d7477545f4f3eaec5ff4b2b782f90'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:11.602006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02d7477545f4f3eaec5ff4b2b782f90'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:11.607574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1263/2502] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:11 2022] DELETE /identity/v3/users/c02d7477545f4f3eaec5ff4b2b782f90 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:11.612187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:11.612673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:11.612779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:11.629027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:11.630349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:11.687184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1240/2503] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:11.696833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:11.698226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:11.753295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606b87-63ca-4c46-aca4-b6ef053d92b4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:11.756853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:11.757524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:11.757803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:11.758075 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:11.767510 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:11.768947 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:11.778021 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1264/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:12.033460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.035530 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:12.049296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527bc59-ae47-4c36-a336-8475bf338231 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.054609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.055653 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.055817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.056203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] PATH_INFO: `/v3/projects/784297060cdb4a689d02c0a23d3586a4` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.057585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=784297060cdb4a689d02c0a23d3586a4)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.059393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.106798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784297060cdb4a689d02c0a23d3586a4', 'request_id': 'req-25014bfc-9e02-4d04-bcd8-f819d23a49cd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.113070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784297060cdb4a689d02c0a23d3586a4', 'request_id': 'req-25014bfc-9e02-4d04-bcd8-f819d23a49cd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.120330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784297060cdb4a689d02c0a23d3586a4', 'request_id': 'req-25014bfc-9e02-4d04-bcd8-f819d23a49cd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.131603 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] The token cache is being invalidate because project 784297060cdb4a689d02c0a23d3586a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:12.131889 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.132508 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.134066 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1241/2505] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:12 2022] DELETE /identity/v3/projects/784297060cdb4a689d02c0a23d3586a4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:12.138443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.147766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64711c98-cb3d-4ed3-ac00-d9f0a9dd81c2 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.201099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.202013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.202295 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.202569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] PATH_INFO: `/v3/users/9a55cf2395dc4ea8bf3a4cef14b448ae` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.203730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a55cf2395dc4ea8bf3a4cef14b448ae)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.205711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.249582 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a55cf2395dc4ea8bf3a4cef14b448ae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.256725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a55cf2395dc4ea8bf3a4cef14b448ae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.264196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a55cf2395dc4ea8bf3a4cef14b448ae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.264864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a55cf2395dc4ea8bf3a4cef14b448ae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.276205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-2ce4df0c-1829-4fb6-8eab-8867754a8752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a55cf2395dc4ea8bf3a4cef14b448ae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.281806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1265/2506] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:12 2022] DELETE /identity/v3/users/9a55cf2395dc4ea8bf3a4cef14b448ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:12.541178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.542688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:12.556254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014bfc-9e02-4d04-bcd8-f819d23a49cd admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.610373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.611985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.612265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.612846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] PATH_INFO: `/v3/projects/963edab66f074af8894c4858cfb4906a` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.613732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=963edab66f074af8894c4858cfb4906a)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.615650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.659228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963edab66f074af8894c4858cfb4906a', 'request_id': 'req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.664517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963edab66f074af8894c4858cfb4906a', 'request_id': 'req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.671609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963edab66f074af8894c4858cfb4906a', 'request_id': 'req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.682977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] The token cache is being invalidate because project 963edab66f074af8894c4858cfb4906a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:12.683258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.683898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-8f16b4a9-b58b-4694-9f82-ea5d06a245ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:12.685460 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1242/2507] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:12 2022] DELETE /identity/v3/projects/963edab66f074af8894c4858cfb4906a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:12.690467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.690963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.691072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.708797 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:12.710042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:12.767317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1266/2508] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:12.775274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389981-061e-4172-848b-3159d915a479 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.775566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389981-061e-4172-848b-3159d915a479 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.775847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25389981-061e-4172-848b-3159d915a479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.793923 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-25389981-061e-4172-848b-3159d915a479 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:12.795053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-25389981-061e-4172-848b-3159d915a479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:12.803619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1243/2509] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:12.807559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.817044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306e36c-c2b6-41b8-9003-3d213a39013f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.821628 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.822277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.822560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.822836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.823571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:12.823905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.825531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.837278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1267/2510] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:12.841502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25389981-061e-4172-848b-3159d915a479 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.851252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25389981-061e-4172-848b-3159d915a479 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.855915 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.856552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.856831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.857137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.857846 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.859749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.883934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1244/2511] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:12.888288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.898725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b523c83-f4b4-4237-95eb-ce6282b6d24c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.952417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.953076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.953401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.953681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:12.954882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:12.956860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:12.976581 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1268/2512] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:12 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:26:12.980825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:12.991020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf6fc4-e913-4f4f-ad21-7c87befce95d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:12.997003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:12.998150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:12.998646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:12.999111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.000430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.003341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.018940 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1245/2513] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:13.023774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.034908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1449-b375-4344-b82c-1053bf0983e3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.039530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.040186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.040471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.040747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.041498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.043095 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae86d3d-1461-4473-a194-6cc9cd3bff8e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.052802 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1269/2514] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:13.056869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.066641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc81e-e338-4d60-8357-e4acd4e21756 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.071120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.071977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.072255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.072526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] PATH_INFO: `/v3/projects/4e266dc3041a4c578dec831091a54449/users/856164ca6ea045ad992c026c40de05b2/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.086863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e266dc3041a4c578dec831091a54449, user_id=856164ca6ea045ad992c026c40de05b2, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.089558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.102318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1246/2515] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:13 2022] PUT /identity/v3/projects/4e266dc3041a4c578dec831091a54449/users/856164ca6ea045ad992c026c40de05b2/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:13.113723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.114016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.114296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.140342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] MFA Rules not processed for user `856164ca6ea045ad992c026c40de05b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:13.141653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:13.202004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1270/2516] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:13.206901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.265975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a08d40-1b13-489c-84da-09173903dd41 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.271457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.272113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.272401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.272674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.273403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.275337 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.300182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1247/2517] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:13.304487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.315987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8ef77-4945-40da-a078-fa83bd8b53de None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.369097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.369855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.370137 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.370411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.371092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.373011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.393741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1271/2518] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:13 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:13.397624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.407673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce2c-9245-4206-a672-b2b6bf42b55d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.412343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.412984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.413309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.413588 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.414303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.415892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.426518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1248/2519] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:13.430498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.440973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467344ff-fd34-40ad-a259-2a4201a56094 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.445626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.446499 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.446776 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.447047 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] PATH_INFO: `/v3/projects/a88242ec99f847c9a17b0f8d6da3de17/users/e0d5ce41978d47bc92a0558ec4118237/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.462589 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88242ec99f847c9a17b0f8d6da3de17, user_id=e0d5ce41978d47bc92a0558ec4118237, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.465310 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.478558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1272/2520] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:13 2022] PUT /identity/v3/projects/a88242ec99f847c9a17b0f8d6da3de17/users/e0d5ce41978d47bc92a0558ec4118237/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:13.482278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.492108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555ea28-0f5e-4785-bb6f-bcbbc263ca8d admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.548730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.549442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.549735 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.550002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.550749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.552339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5609e-6e37-4775-8163-4fbda65072af admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.562916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1249/2521] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:13.567140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.578163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1b4f9-f647-4dc8-bf04-d7e4e5348788 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.583558 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.584465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.584814 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.585016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] PATH_INFO: `/v3/projects/a88242ec99f847c9a17b0f8d6da3de17/users/e0d5ce41978d47bc92a0558ec4118237/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.587048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88242ec99f847c9a17b0f8d6da3de17, user_id=e0d5ce41978d47bc92a0558ec4118237, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.589800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.600184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1273/2522] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:13 2022] PUT /identity/v3/projects/a88242ec99f847c9a17b0f8d6da3de17/users/e0d5ce41978d47bc92a0558ec4118237/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:13.611199 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.611492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.611768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.639016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] MFA Rules not processed for user `e0d5ce41978d47bc92a0558ec4118237`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:13.640238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:13.705957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1250/2523] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:13.716591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:13.718358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:13.775010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30f97-51ba-433c-8ddf-0d7a6821b5f6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:13.778694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:13.779341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:13.779626 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:13.779902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:13.789015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:13.790533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08594e4-ebca-4c77-b26d-5f620344a5d5 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:13.800442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1274/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:14.342157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:14.401633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801388c-56fe-42d9-b172-a174c9f0e5f5 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:14.406214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:14.407098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:14.407374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:14.408189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] PATH_INFO: `/v3/users/856164ca6ea045ad992c026c40de05b2` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:14.409375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856164ca6ea045ad992c026c40de05b2)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:14.411315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:14.454183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856164ca6ea045ad992c026c40de05b2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.462469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856164ca6ea045ad992c026c40de05b2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.469416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856164ca6ea045ad992c026c40de05b2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.470587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856164ca6ea045ad992c026c40de05b2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.471250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856164ca6ea045ad992c026c40de05b2'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.487446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1251/2525] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:14 2022] DELETE /identity/v3/users/856164ca6ea045ad992c026c40de05b2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:14.492111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:14.492401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:14.492676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:14.509674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:14.510872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:14.566335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1275/2526] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:26:14.576011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:14.577438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:14.633175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086eb1f3-a83c-457f-9eb2-3851281ff189 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:14.636775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:14.637446 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:14.637971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:14.638249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:14.647369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:14.648791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:14.658726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1252/2527] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:14.915705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:14.917145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:14.928862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8948c-d755-4515-a4fe-580e9580ec7a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:14.933605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:14.934459 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:14.934743 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:14.935015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] PATH_INFO: `/v3/projects/4e266dc3041a4c578dec831091a54449` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:14.936186 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e266dc3041a4c578dec831091a54449)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:14.938139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:14.983412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e266dc3041a4c578dec831091a54449', 'request_id': 'req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.989431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e266dc3041a4c578dec831091a54449', 'request_id': 'req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:14.994693 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e266dc3041a4c578dec831091a54449', 'request_id': 'req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.006881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] The token cache is being invalidate because project 4e266dc3041a4c578dec831091a54449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:15.007170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.007812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.009368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1276/2528] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:14 2022] DELETE /identity/v3/projects/4e266dc3041a4c578dec831091a54449 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:15.013984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.024397 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a44cf-efc1-4f47-b5e6-7e9fa3bb4e0e service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.077158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.078031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.078306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.078574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] PATH_INFO: `/v3/users/e0d5ce41978d47bc92a0558ec4118237` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.080341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d5ce41978d47bc92a0558ec4118237)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.082289 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.124374 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d5ce41978d47bc92a0558ec4118237'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.132631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d5ce41978d47bc92a0558ec4118237'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.140101 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d5ce41978d47bc92a0558ec4118237'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.140739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d5ce41978d47bc92a0558ec4118237'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.141368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0d4c0de-a002-47b2-8530-83698469a641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d5ce41978d47bc92a0558ec4118237'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.157609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1253/2529] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:15 2022] DELETE /identity/v3/users/e0d5ce41978d47bc92a0558ec4118237 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:15.433090 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.434637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:15.448452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae177e7-b9f3-4b95-b07c-4999c2bfff49 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.503725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.504577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.504858 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.505131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] PATH_INFO: `/v3/projects/a88242ec99f847c9a17b0f8d6da3de17` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.506324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88242ec99f847c9a17b0f8d6da3de17)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.508282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.552841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88242ec99f847c9a17b0f8d6da3de17', 'request_id': 'req-b506e1ed-ca74-4259-97e9-8a645178745c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.558753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88242ec99f847c9a17b0f8d6da3de17', 'request_id': 'req-b506e1ed-ca74-4259-97e9-8a645178745c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.564038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88242ec99f847c9a17b0f8d6da3de17', 'request_id': 'req-b506e1ed-ca74-4259-97e9-8a645178745c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.575800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] The token cache is being invalidate because project a88242ec99f847c9a17b0f8d6da3de17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:15.576089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.576698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b506e1ed-ca74-4259-97e9-8a645178745c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:15.578288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1277/2530] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:15 2022] DELETE /identity/v3/projects/a88242ec99f847c9a17b0f8d6da3de17 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:15.583175 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.583467 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.583745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.601901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:15.603097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:15.659625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1254/2531] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:15.668149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.668477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.668784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.688081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:15.689325 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:15.697514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1278/2532] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:15.701556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.711201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc69a-46b1-4151-9383-5290e8fd3c18 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.715776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.716426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.716713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.716991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.717743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:15.718058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.719690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.731256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1255/2533] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:15.735608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.745469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f276a7-cab2-45af-abe2-6b9eb0fa9b4b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.750187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.750831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.751118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.751395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.752098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.754052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.778613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1279/2534] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:15.783122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.792722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9eb174-e563-4373-898e-4ef987f6764b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.847547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.848217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.848502 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.848779 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.849521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.851469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.870509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1256/2535] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:15 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:15.874489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.884446 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b950-f066-4930-af57-1791c2f46612 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.889248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.889897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.890177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.890449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.891187 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.893436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.903364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1280/2536] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:15.907023 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.918117 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33f5c7-a797-4fee-8540-75edf4409063 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.923338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.923989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.924267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.924534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.925279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.926985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19bd60-e9e0-4eb3-a80a-9453bbf2a228 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.937583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1257/2537] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:15.941958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:15.951686 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a713634-e485-4057-9974-022834324bc6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:15.956870 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:15.957777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.958064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.958337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] PATH_INFO: `/v3/projects/13a57c0d918d4949b06bc550e0619ab9/users/4e186ae22cf946f088f328b78decd3d0/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:15.972980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a57c0d918d4949b06bc550e0619ab9, user_id=4e186ae22cf946f088f328b78decd3d0, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:15.975712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:15.988242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1281/2538] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:15 2022] PUT /identity/v3/projects/13a57c0d918d4949b06bc550e0619ab9/users/4e186ae22cf946f088f328b78decd3d0/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:15.998436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:15.998728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:15.999006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.026000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] MFA Rules not processed for user `4e186ae22cf946f088f328b78decd3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:16.027210 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:16.089145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1258/2539] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:16.093640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.152390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf46-6e90-4635-9756-34207d21f21c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.156953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.158254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.158531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.158799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.159482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.161397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.184603 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1282/2540] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:26:16.188618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.198974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65cac-d3ee-4632-b3f7-e3f4418c261a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.253275 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.253941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.254227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.254505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.255201 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.257168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.284983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1259/2541] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:16 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:16.290130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.301305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f725-f245-4b81-a7b3-8a8225722e1e admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.305402 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.306059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.306362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.306634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.307351 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.308960 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.319747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1283/2542] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:16.323976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.334624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39141e-c291-4f21-bbf6-a48c6cbc08d6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.339330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.340209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.340493 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.340775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] PATH_INFO: `/v3/projects/5a495f714453456d86bad040bbcf497d/users/7e257c82266640b889e4b9f6d4e67686/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.355037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a495f714453456d86bad040bbcf497d, user_id=7e257c82266640b889e4b9f6d4e67686, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.357756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.370219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1260/2543] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:16 2022] PUT /identity/v3/projects/5a495f714453456d86bad040bbcf497d/users/7e257c82266640b889e4b9f6d4e67686/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:16.374109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.384382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394cc5c-dd38-4009-a36c-98f9b60c48f0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.436867 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.437541 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.437827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.438101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.439313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.440888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5929ab-f602-4327-b29d-d47001ac1f8b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.450278 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1284/2544] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:16.454336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.464868 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b361a-eeb6-42a6-bcbb-f649667d8553 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.469506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.470376 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.470661 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.470938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] PATH_INFO: `/v3/projects/5a495f714453456d86bad040bbcf497d/users/7e257c82266640b889e4b9f6d4e67686/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.472890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a495f714453456d86bad040bbcf497d, user_id=7e257c82266640b889e4b9f6d4e67686, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.475652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.485487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1261/2545] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:16 2022] PUT /identity/v3/projects/5a495f714453456d86bad040bbcf497d/users/7e257c82266640b889e4b9f6d4e67686/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:16.495406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.495816 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.496181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.523109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] MFA Rules not processed for user `7e257c82266640b889e4b9f6d4e67686`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:16.524314 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:16.588076 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1285/2546] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:16.599687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:16.601506 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:16.661425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f909d9-62de-4ba7-9539-9345b030fc44 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:16.665111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:16.665785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:16.666070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:16.666346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:16.675520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:16.676944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641ade-1228-49c3-8fb6-b55abf6ae13b service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:16.686314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1262/2547] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:17.028394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:17.089182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b513f-2ab8-4d0f-9b7a-39927a09a1b7 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:17.093700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:17.094557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:17.094860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:17.095119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] PATH_INFO: `/v3/users/4e186ae22cf946f088f328b78decd3d0` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:17.096293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e186ae22cf946f088f328b78decd3d0)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:17.098267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:17.142457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e186ae22cf946f088f328b78decd3d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.149734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e186ae22cf946f088f328b78decd3d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.156834 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e186ae22cf946f088f328b78decd3d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.157489 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e186ae22cf946f088f328b78decd3d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.169098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e186ae22cf946f088f328b78decd3d0'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.175045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1286/2548] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:17 2022] DELETE /identity/v3/users/4e186ae22cf946f088f328b78decd3d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:17.179576 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:17.179866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:17.180171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:17.197800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:17.199002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:17.255659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1263/2549] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:17.265420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:17.266881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:17.328608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f52ae-333b-4f8c-bfd3-020d0ebc744f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:17.332801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:17.333632 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:17.333925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:17.334203 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:17.343471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:17.344923 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:17.354583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1287/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:17.627104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:17.628571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:17.642236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a90cbc-8ee2-4538-b095-45eafb9532ce None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:17.647373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:17.648253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:17.648533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:17.648803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] PATH_INFO: `/v3/projects/13a57c0d918d4949b06bc550e0619ab9` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:17.650258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a57c0d918d4949b06bc550e0619ab9)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:17.653230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:17.703614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a57c0d918d4949b06bc550e0619ab9', 'request_id': 'req-60f007e1-0bf2-4498-9997-2098324c3a40'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.709107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a57c0d918d4949b06bc550e0619ab9', 'request_id': 'req-60f007e1-0bf2-4498-9997-2098324c3a40'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.716829 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a57c0d918d4949b06bc550e0619ab9', 'request_id': 'req-60f007e1-0bf2-4498-9997-2098324c3a40'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.729674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] The token cache is being invalidate because project 13a57c0d918d4949b06bc550e0619ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:17.730051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.730769 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.735340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1264/2551] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:17 2022] DELETE /identity/v3/projects/13a57c0d918d4949b06bc550e0619ab9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:17.736493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:17.749243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353f0f2-3894-4261-ab5d-08f2c07c4b71 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:17.807831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:17.808894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:17.809178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:17.809485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] PATH_INFO: `/v3/users/7e257c82266640b889e4b9f6d4e67686` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:17.811424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e257c82266640b889e4b9f6d4e67686)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:17.813433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:17.863096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e257c82266640b889e4b9f6d4e67686'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.870476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e257c82266640b889e4b9f6d4e67686'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.877645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e257c82266640b889e4b9f6d4e67686'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.878432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e257c82266640b889e4b9f6d4e67686'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.890941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-23d9277a-1973-4f78-b0d0-3ae1f9d6d8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e257c82266640b889e4b9f6d4e67686'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:17.896755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1288/2552] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:17 2022] DELETE /identity/v3/users/7e257c82266640b889e4b9f6d4e67686 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:18.165196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.166839 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:18.180027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f007e1-0bf2-4498-9997-2098324c3a40 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.235436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.236299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.236581 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.236858 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] PATH_INFO: `/v3/projects/5a495f714453456d86bad040bbcf497d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.238058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a495f714453456d86bad040bbcf497d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.240006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.286860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a495f714453456d86bad040bbcf497d', 'request_id': 'req-73106d01-e348-440a-a0f6-2fb2059ddb0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:18.292681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a495f714453456d86bad040bbcf497d', 'request_id': 'req-73106d01-e348-440a-a0f6-2fb2059ddb0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:18.301423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a495f714453456d86bad040bbcf497d', 'request_id': 'req-73106d01-e348-440a-a0f6-2fb2059ddb0c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:18.312784 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] The token cache is being invalidate because project 5a495f714453456d86bad040bbcf497d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:18.313072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:18.313739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-73106d01-e348-440a-a0f6-2fb2059ddb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:18.315411 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1265/2553] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:18 2022] DELETE /identity/v3/projects/5a495f714453456d86bad040bbcf497d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:18.320910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.321430 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.321526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.339665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:18.340905 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:18.397821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1289/2554] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:18.406832 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.407153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.407428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.425518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:18.426908 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:18.434628 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1266/2555] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:18.438616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.448359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b787bd-a598-440b-b59f-5bed7f7e3623 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.452824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.453495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.453775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.454045 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.454757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:18.455058 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.456640 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.468189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1290/2556] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:26:18.472412 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.481970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab97b-136b-4fd2-8596-dd5f6c8c713b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.486486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.487116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.487394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.487665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.488931 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.490960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.516427 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1267/2557] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:18.520698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.530563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76133-6b5b-4157-b3a1-72bd9e947b36 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.584552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.585239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.585587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.585866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.586546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.588469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.610233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1291/2558] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:18 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:18.615183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.625675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd888e5a-247d-4ae2-972c-ae7497ececb6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.630843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.631491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.631771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.632096 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.632815 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.634444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.645329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1268/2559] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:18.649049 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.658795 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c8e-e971-49ea-8967-78e99f38b2cf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.663521 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.664172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.664458 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.664735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.665502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.667097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd8840-315c-4a50-8dd5-c8c31fa4dca3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.676601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1292/2560] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:18.680533 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.690114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814009ea-2e25-48fb-992f-461f648ef5a9 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.695126 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.695982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.696264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.696535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] PATH_INFO: `/v3/projects/a7753db2eb8b47a48aa484ac459d186a/users/5c1ccf2fd3e64571a9c4620afb22a0d8/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.711887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7753db2eb8b47a48aa484ac459d186a, user_id=5c1ccf2fd3e64571a9c4620afb22a0d8, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.714585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.726972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1269/2561] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:18 2022] PUT /identity/v3/projects/a7753db2eb8b47a48aa484ac459d186a/users/5c1ccf2fd3e64571a9c4620afb22a0d8/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:18.732207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a72bf-3d0e-46fd-bc4f-1fa63f3c53f6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.732545 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a72bf-3d0e-46fd-bc4f-1fa63f3c53f6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.732806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a72bf-3d0e-46fd-bc4f-1fa63f3c53f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.749849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-680a72bf-3d0e-46fd-bc4f-1fa63f3c53f6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:18.751031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-680a72bf-3d0e-46fd-bc4f-1fa63f3c53f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:18.807886 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1293/2562] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:18.818102 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:18.819785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:18.874408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a635e-a9ff-44c6-bac0-16b0bb5870cd admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:18.877932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:18.878565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:18.878843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:18.879684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:18.888627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:18.890078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:18.899245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1270/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:19.556520 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.557071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.557071 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.585429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] MFA Rules not processed for user `5c1ccf2fd3e64571a9c4620afb22a0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:19.586677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:19.659184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1294/2564] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:19.665000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:19.675097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf225c5a-3086-4d13-8279-198ae4d8dc1c service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:19.679833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:19.680521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.680803 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.681079 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.681849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:19.683701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:19.713331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1271/2565] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:19 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:19.717429 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:19.729607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42431912-dbaf-417b-85c3-2c59a7bdd57b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:19.790633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:19.791344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.791625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.791899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.792608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:19.794652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:19.819044 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1295/2566] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:19 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:19.824461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:19.839499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a60e-b98e-4dc9-ba9d-62cd18b1814e admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:19.844521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:19.845184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.845494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.845966 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.846680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:19.848580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:19.859640 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1272/2567] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:26:19.864390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:19.874751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9a19-4172-4965-bf85-a7ce764a60bf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:19.880054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:19.880938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.881247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.881517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] PATH_INFO: `/v3/projects/0503da0814204d948e6201af042e807e/users/77f44dabed9a4f98a1defa0fd43d3d18/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.896175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0503da0814204d948e6201af042e807e, user_id=77f44dabed9a4f98a1defa0fd43d3d18, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:19.899195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:19.912665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1296/2568] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:19 2022] PUT /identity/v3/projects/0503da0814204d948e6201af042e807e/users/77f44dabed9a4f98a1defa0fd43d3d18/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:19.916580 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:19.928214 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009e65d-57cb-4434-b660-c2d6b65850b2 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:19.981856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:19.982623 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:19.982975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:19.983317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:19.984105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:19.985813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a843341-0b34-4d6c-a241-00378fc6b1bb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:19.996016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1273/2569] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:20.000485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:20.010790 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bddbe-fc95-4683-b641-c92497955850 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:20.015676 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:20.016554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:20.016837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:20.017111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] PATH_INFO: `/v3/projects/0503da0814204d948e6201af042e807e/users/77f44dabed9a4f98a1defa0fd43d3d18/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:20.019123 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0503da0814204d948e6201af042e807e, user_id=77f44dabed9a4f98a1defa0fd43d3d18, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:20.022099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:20.033197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1297/2570] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:19 2022] PUT /identity/v3/projects/0503da0814204d948e6201af042e807e/users/77f44dabed9a4f98a1defa0fd43d3d18/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:20.743041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:20.743544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:20.743678 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:20.769982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] MFA Rules not processed for user `77f44dabed9a4f98a1defa0fd43d3d18`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:20.771292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:20.858471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1274/2571] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:20.866775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:20.868591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:20.934218 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee9b2-50ef-46f6-8dca-e3e36cff2f5a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:20.939670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:20.940393 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:20.940682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:20.941041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:21.008418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:21.009925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:21.019078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1298/2572] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:22.373486 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:22.374885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:22.386518 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792b16f-ee23-41ca-9696-904660d8d318 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:22.390705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:22.391340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:22.391643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:22.391902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:22.400744 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:22.402361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:22.412076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1275/2573] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:24.343483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:24.397527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b40ec-7867-4a25-ab44-d0f5b34dd79a service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:24.401038 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:24.401711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:24.401995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:24.402269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:24.404019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:24.462424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:24.463859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:24.473263 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1299/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:27.814982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:27.816430 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:27.832742 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361e41a-cc24-4e27-890d-89967071c677 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:27.838520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:27.839399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:27.839680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:27.839957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] PATH_INFO: `/v3/users/3d32a8df74c74851adf017d2132ad13c` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:27.841139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d32a8df74c74851adf017d2132ad13c)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:27.843116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:27.889220 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d32a8df74c74851adf017d2132ad13c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:27.897020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d32a8df74c74851adf017d2132ad13c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:27.903884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d32a8df74c74851adf017d2132ad13c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:27.904765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d32a8df74c74851adf017d2132ad13c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:27.905934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-fca4633d-0640-4e70-a288-9953df929401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d32a8df74c74851adf017d2132ad13c'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:27.924650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1276/2575] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:27 2022] DELETE /identity/v3/users/3d32a8df74c74851adf017d2132ad13c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:28.097542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.107881 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920dd1f-73b0-47c8-9533-9b3ff995bd2e service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.165385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.166245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.166527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.166803 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] PATH_INFO: `/v3/projects/9865f76728534bd4a16949abe04f7c21` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.167979 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9865f76728534bd4a16949abe04f7c21)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.169929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.215288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9865f76728534bd4a16949abe04f7c21', 'request_id': 'req-4bec33a5-5ee8-4b67-97cb-91310796a99f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:28.221417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9865f76728534bd4a16949abe04f7c21', 'request_id': 'req-4bec33a5-5ee8-4b67-97cb-91310796a99f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:28.227438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9865f76728534bd4a16949abe04f7c21', 'request_id': 'req-4bec33a5-5ee8-4b67-97cb-91310796a99f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:28.240016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] The token cache is being invalidate because project 9865f76728534bd4a16949abe04f7c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:28.240412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:28.241573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-4bec33a5-5ee8-4b67-97cb-91310796a99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:28.243227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1300/2576] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:28 2022] DELETE /identity/v3/projects/9865f76728534bd4a16949abe04f7c21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:28.248084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.248378 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.248656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.267817 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:28.269024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:28.324957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1277/2577] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:28.332812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.333099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.333404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.351631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:28.352813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:28.360807 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1301/2578] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:28.364814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.374783 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92167bd0-8982-4b86-9f0c-8390358866d0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.379367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.380010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.380300 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.380575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.381802 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:28.382104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.384076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.396147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1278/2579] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:28.400700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.410019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9304baa-97b6-4160-8309-9669f0d2d492 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.414661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.415299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.415584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.415860 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.416552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.418501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.442735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1302/2580] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/projects => generated 403 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:28.446964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.456494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e285a-174e-4a2b-8d72-ac655ea0b224 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.510556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.511147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.511433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.511710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.512403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.514690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.533394 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1279/2581] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/users => generated 302 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:28.537619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.547825 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa567-9e23-42b0-add3-9ca01a358288 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.552411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.553587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.553866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.554135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.554875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.556464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.566507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1303/2582] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:28.570764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.580404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1596e42-8ec2-4414-839f-11088add2c7f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.584989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.585659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.585945 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.586242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.586947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.588520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794be8a-5749-4865-ab83-133e3faa367c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.597975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1280/2583] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:28.601830 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.611533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5eb40-7881-4e70-a697-4d890e5d5167 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.616599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.617495 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.617779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.618054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] PATH_INFO: `/v3/projects/fa8a2b821bc04d93a5f6d86179aa5771/users/1e5496bea0da44a6a9adbdcda0f215ea/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.632482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8a2b821bc04d93a5f6d86179aa5771, user_id=1e5496bea0da44a6a9adbdcda0f215ea, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.635282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.648596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1304/2584] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:28 2022] PUT /identity/v3/projects/fa8a2b821bc04d93a5f6d86179aa5771/users/1e5496bea0da44a6a9adbdcda0f215ea/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:28.659379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.659671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.659950 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.685407 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] MFA Rules not processed for user `1e5496bea0da44a6a9adbdcda0f215ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:28.686608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:28.746916 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1281/2585] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:28.751307 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.812505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35178541-9bd9-4951-b3ab-8051da98a390 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.817041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.817726 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.818008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.818279 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.819641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.821566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.849327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1305/2586] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:28.851057 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.861510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eff5-121b-4408-bc62-991f045f3c46 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.915986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.916655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.916936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.917222 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.917922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.919821 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.939529 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1282/2587] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:28 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:26:28.943399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.953705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5c32-5a85-476f-9a7b-630e34391040 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:28.959827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:28.960800 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:28.961507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:28.961952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:28.963738 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:28.966561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:28.981162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1306/2588] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:28.986002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:28.996913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd765fe-1ba8-4714-b0b9-3955b729bcb5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.001736 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.005005 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.005391 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.005593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] PATH_INFO: `/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac/users/d8686e347015426dbda7d55a79edaacc/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.023435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5ec63e749c4f248ea4ccc3ce1a8bac, user_id=d8686e347015426dbda7d55a79edaacc, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.026521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.044111 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1283/2589] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:28 2022] PUT /identity/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac/users/d8686e347015426dbda7d55a79edaacc/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:26:29.047899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:29.058611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d15d0-9d3c-460f-8a86-9166af080ec4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.113983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.114651 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.114932 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.115206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.115968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.117620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977ad3a-0900-434c-ba44-839a18edf884 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.127273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1307/2590] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:29.132156 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:29.142386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eca61a-a7e6-4f24-9b06-5efaa37d0e2a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.147582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.148448 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.148732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.149003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] PATH_INFO: `/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac/users/d8686e347015426dbda7d55a79edaacc/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.151000 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5ec63e749c4f248ea4ccc3ce1a8bac, user_id=d8686e347015426dbda7d55a79edaacc, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.153731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.163516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1284/2591] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:29 2022] PUT /identity/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac/users/d8686e347015426dbda7d55a79edaacc/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:29.173514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.173813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.174096 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.200480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] MFA Rules not processed for user `d8686e347015426dbda7d55a79edaacc`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:29.201715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:29.266579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1308/2592] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:29.277519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:29.279136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:29.342509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6f95-16d6-4476-8d9c-80acdf22bf27 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.346224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.346869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.347151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.347424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.356213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.357706 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982653d-8654-4902-a1d5-8063c5ae03ec service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.367544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1285/2593] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:29.496385 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:29.557142 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1db4-74ba-40cb-8fe8-9c902d6429bb None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.561576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.562436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.562719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.563018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] PATH_INFO: `/v3/users/1e5496bea0da44a6a9adbdcda0f215ea` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.564195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5496bea0da44a6a9adbdcda0f215ea)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.566191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.612579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5496bea0da44a6a9adbdcda0f215ea'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:29.621968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5496bea0da44a6a9adbdcda0f215ea'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:29.629976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5496bea0da44a6a9adbdcda0f215ea'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:29.630605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5496bea0da44a6a9adbdcda0f215ea'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:29.642086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5496bea0da44a6a9adbdcda0f215ea'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:29.647742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1309/2594] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:29 2022] DELETE /identity/v3/users/1e5496bea0da44a6a9adbdcda0f215ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:29.652248 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.652543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.652825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.670371 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:29.671561 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:29.726753 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1286/2595] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:29.736207 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:29.737730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:29.793644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8331a3-d8bc-4f85-889e-afdfd129888f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:29.798364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:29.799014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:29.799323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:29.799698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:29.809950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:29.811321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:29.820503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1310/2596] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:30.083106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.085161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:30.105743 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96069-1782-4ccb-9208-0ef45e39ff48 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:30.111380 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:30.112614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.113179 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.113519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] PATH_INFO: `/v3/projects/fa8a2b821bc04d93a5f6d86179aa5771` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.114682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8a2b821bc04d93a5f6d86179aa5771)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:30.116659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:30.165697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8a2b821bc04d93a5f6d86179aa5771', 'request_id': 'req-895ecb49-61fa-4893-b242-00c54be7b685'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.170980 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8a2b821bc04d93a5f6d86179aa5771', 'request_id': 'req-895ecb49-61fa-4893-b242-00c54be7b685'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.178625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8a2b821bc04d93a5f6d86179aa5771', 'request_id': 'req-895ecb49-61fa-4893-b242-00c54be7b685'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.189891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] The token cache is being invalidate because project fa8a2b821bc04d93a5f6d86179aa5771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:30.190181 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.190799 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.192331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1287/2597] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:30 2022] DELETE /identity/v3/projects/fa8a2b821bc04d93a5f6d86179aa5771 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:30.196365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.206249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c824d2-783d-41aa-9360-81b034ef801a service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:30.263078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:30.263922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.264222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.264568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] PATH_INFO: `/v3/users/d8686e347015426dbda7d55a79edaacc` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.266005 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8686e347015426dbda7d55a79edaacc)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:30.267919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:30.317713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8686e347015426dbda7d55a79edaacc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.324338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8686e347015426dbda7d55a79edaacc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.331340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8686e347015426dbda7d55a79edaacc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.331950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8686e347015426dbda7d55a79edaacc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.343919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8f54e7e2-c099-4286-ab47-5e3d3da25554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8686e347015426dbda7d55a79edaacc'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.350382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1311/2598] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:30 2022] DELETE /identity/v3/users/d8686e347015426dbda7d55a79edaacc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:30.610975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.612540 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:30.625423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ecb49-61fa-4893-b242-00c54be7b685 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:30.680667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:30.681566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.681855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.682129 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] PATH_INFO: `/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.683285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5ec63e749c4f248ea4ccc3ce1a8bac)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:30.685186 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:30.728500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5ec63e749c4f248ea4ccc3ce1a8bac', 'request_id': 'req-33828d0c-3681-4d8e-845d-facbbd6f4243'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.733632 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5ec63e749c4f248ea4ccc3ce1a8bac', 'request_id': 'req-33828d0c-3681-4d8e-845d-facbbd6f4243'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.740107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5ec63e749c4f248ea4ccc3ce1a8bac', 'request_id': 'req-33828d0c-3681-4d8e-845d-facbbd6f4243'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.750934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] The token cache is being invalidate because project 3f5ec63e749c4f248ea4ccc3ce1a8bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:30.751216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.751837 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-33828d0c-3681-4d8e-845d-facbbd6f4243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:30.753357 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1288/2599] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:30 2022] DELETE /identity/v3/projects/3f5ec63e749c4f248ea4ccc3ce1a8bac => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:30.759156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.759156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.759353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.777392 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:30.778579 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:30.839485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1312/2600] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:26:30.847172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.847464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.847746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.866510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:30.867649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:30.875516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1289/2601] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:30.879635 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.890008 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef821243-2573-4a4a-af24-59e43ece3cc0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:30.894488 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:30.895133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.895415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.895691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.896407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:30.896781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:30.898531 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:30.909706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1313/2602] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:30.913764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.922688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd449c8c-f1f3-4aa4-b9d4-b9771b94cadb None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:30.927314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:30.928439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:30.928721 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:30.928989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:30.929727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:30.931614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:30.956065 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1290/2603] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:30 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:30.960294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:30.969919 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581549-f445-4c11-adf1-f6db7337a84a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.025637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.026297 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.026580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.026854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.027528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.029453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.049797 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1314/2604] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:30 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:31.054400 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.064497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f7eb-f19a-41f5-aeba-cb92f963d84f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.069662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.070306 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.070587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.070860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.071574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.073161 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.083074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1291/2605] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:31.086909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.096502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85a4e2-3809-40db-aea2-ea3bc8f4fb0b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.101703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.102362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.102634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.102909 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.103625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.105224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7cb0-8f41-489d-a6a4-abf2321a66de admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.116315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1315/2606] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:26:31.120271 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.130021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd479b2-f25c-49dc-8431-948152622ffe admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.134816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.135691 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.135976 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.136270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] PATH_INFO: `/v3/projects/85551c72475b416fab9d515a98be00b6/users/f9ec114058fc4489a6b7d6f1bc9bc2f1/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.150514 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85551c72475b416fab9d515a98be00b6, user_id=f9ec114058fc4489a6b7d6f1bc9bc2f1, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.153171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.165633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1292/2607] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:31 2022] PUT /identity/v3/projects/85551c72475b416fab9d515a98be00b6/users/f9ec114058fc4489a6b7d6f1bc9bc2f1/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:31.176882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.177174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.177485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.203091 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] MFA Rules not processed for user `f9ec114058fc4489a6b7d6f1bc9bc2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:31.204274 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:31.278769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1316/2608] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:31.283276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.343440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7af34-47ed-43db-8d6b-5166b6c00601 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.348116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.348768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.349049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.349345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.350545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.352424 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.381703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1293/2609] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:31 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:31.382836 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.394063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba890-782a-40b5-bd84-551c5d6816f5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.448893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.449594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.449899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.450246 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.450849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.452775 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.472181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1317/2610] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:31 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:26:31.476849 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.486936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9f3b-2aa3-4816-9a5f-356f2fa3e666 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.491610 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.492264 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.492545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.492818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.493566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.495146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.508288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1294/2611] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:31.513917 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.524366 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb8ff3-871f-4bbb-824e-a65dc4f54455 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.528994 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.529901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.530185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.530453 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] PATH_INFO: `/v3/projects/4919ffc8eccb493f8e1a02240da3742d/users/637fc4650e8c4bf9a4fa7f9b78693258/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.549908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4919ffc8eccb493f8e1a02240da3742d, user_id=637fc4650e8c4bf9a4fa7f9b78693258, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.554088 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.569518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1318/2612] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:31 2022] PUT /identity/v3/projects/4919ffc8eccb493f8e1a02240da3742d/users/637fc4650e8c4bf9a4fa7f9b78693258/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:31.574247 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.587516 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33589bbd-e8bd-4dff-9e26-c287f6f26890 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.652146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.652824 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.653134 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.653439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.654190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.655807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b558e4-02b4-49f8-bc07-8d288a8664a9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.666421 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1295/2613] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:31.670648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.680783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363399b-bbd2-408e-9998-d8c73faec2bb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.685331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.686195 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.686547 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.686850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] PATH_INFO: `/v3/projects/4919ffc8eccb493f8e1a02240da3742d/users/637fc4650e8c4bf9a4fa7f9b78693258/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.688759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4919ffc8eccb493f8e1a02240da3742d, user_id=637fc4650e8c4bf9a4fa7f9b78693258, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.691440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.701569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1319/2614] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:31 2022] PUT /identity/v3/projects/4919ffc8eccb493f8e1a02240da3742d/users/637fc4650e8c4bf9a4fa7f9b78693258/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:31.712032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.712336 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.712612 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.738176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] MFA Rules not processed for user `637fc4650e8c4bf9a4fa7f9b78693258`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:31.739385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:31.803509 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1296/2615] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:31.815032 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.816765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:31.876865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd823-1fca-4042-92bd-b1ccd8b8d8e9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.880736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.881944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.882226 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.882497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:31.891620 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:31.893122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:31.903276 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1320/2616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:31.975004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:31.984433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9dc78-c43d-4749-afa0-52fe96eafdf6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:31.988084 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:31.988711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:31.988993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:31.989297 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:32.044200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:32.045658 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:32.054267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1297/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:35.266497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:35.267902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:35.331571 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ad90d-0c14-42ac-8691-99f032f3135f service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:35.336169 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:35.337006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:35.337436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:35.337717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] PATH_INFO: `/v3/users/5c1ccf2fd3e64571a9c4620afb22a0d8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:35.339177 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1ccf2fd3e64571a9c4620afb22a0d8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:35.341111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:35.388642 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1ccf2fd3e64571a9c4620afb22a0d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.395770 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1ccf2fd3e64571a9c4620afb22a0d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.402813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1ccf2fd3e64571a9c4620afb22a0d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.403449 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1ccf2fd3e64571a9c4620afb22a0d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.414727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1ccf2fd3e64571a9c4620afb22a0d8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.420436 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1321/2618] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:35 2022] DELETE /identity/v3/users/5c1ccf2fd3e64571a9c4620afb22a0d8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:35.586773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:35.597635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905160ae-31e3-4200-a034-71cd039a71c9 service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:35.652094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:35.652951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:35.653263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:35.653541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] PATH_INFO: `/v3/projects/a7753db2eb8b47a48aa484ac459d186a` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:35.654701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7753db2eb8b47a48aa484ac459d186a)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:35.656596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:35.702726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7753db2eb8b47a48aa484ac459d186a', 'request_id': 'req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.707927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7753db2eb8b47a48aa484ac459d186a', 'request_id': 'req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.715751 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7753db2eb8b47a48aa484ac459d186a', 'request_id': 'req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.727189 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] The token cache is being invalidate because project a7753db2eb8b47a48aa484ac459d186a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:35.727474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.728082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.729616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1298/2619] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:35 2022] DELETE /identity/v3/projects/a7753db2eb8b47a48aa484ac459d186a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:35.733527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:35.734911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:35.748875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5ef1d-5b01-4cd1-8247-b212453ecfc6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:35.802305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:35.803625 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:35.803902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:35.804174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] PATH_INFO: `/v3/users/77f44dabed9a4f98a1defa0fd43d3d18` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:35.805386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f44dabed9a4f98a1defa0fd43d3d18)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:35.807316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:35.852892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f44dabed9a4f98a1defa0fd43d3d18'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.859457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f44dabed9a4f98a1defa0fd43d3d18'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.867069 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f44dabed9a4f98a1defa0fd43d3d18'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.867855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f44dabed9a4f98a1defa0fd43d3d18'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.879342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5e092bc7-a241-4820-a30d-22b25f4118e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f44dabed9a4f98a1defa0fd43d3d18'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:35.885065 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1322/2620] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:35 2022] DELETE /identity/v3/users/77f44dabed9a4f98a1defa0fd43d3d18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:36.051183 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.052714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:36.066631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1ceeb-9bdc-4853-8f9a-c52217daa42f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.121955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.122804 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.123082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.123353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] PATH_INFO: `/v3/projects/0503da0814204d948e6201af042e807e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.124501 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0503da0814204d948e6201af042e807e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.126478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.169449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0503da0814204d948e6201af042e807e', 'request_id': 'req-391deac9-747a-45b7-b3c2-fa5e8567f553'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:36.174565 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0503da0814204d948e6201af042e807e', 'request_id': 'req-391deac9-747a-45b7-b3c2-fa5e8567f553'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:36.181317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0503da0814204d948e6201af042e807e', 'request_id': 'req-391deac9-747a-45b7-b3c2-fa5e8567f553'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:36.191670 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] The token cache is being invalidate because project 0503da0814204d948e6201af042e807e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:36.191951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:36.192567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-391deac9-747a-45b7-b3c2-fa5e8567f553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:36.194118 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1299/2621] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:36 2022] DELETE /identity/v3/projects/0503da0814204d948e6201af042e807e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:36.199319 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f915-a814-408c-917c-a67738652de9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.199615 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f915-a814-408c-917c-a67738652de9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.199896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f915-a814-408c-917c-a67738652de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.217936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-9643f915-a814-408c-917c-a67738652de9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:36.219145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9643f915-a814-408c-917c-a67738652de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:36.277806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1323/2622] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:36.285790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.286078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.286453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.304750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:36.305906 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:36.313633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1300/2623] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:36.317779 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f915-a814-408c-917c-a67738652de9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.327384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f915-a814-408c-917c-a67738652de9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.331985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.332637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.332927 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.333228 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.334463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:36.334815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.336426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.348466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1324/2624] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:36.353332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.362597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e93ed0-8070-4ec0-9244-d78b3745aa8a None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.367354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.367989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.368270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.368539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.369327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.371139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.395398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1301/2625] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:36.399888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.409694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929d6d9-8f21-4e2d-b0f7-071bf5b703bc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.463801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.464516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.464801 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.465077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.465798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.467723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.486896 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1325/2626] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:26:36.490943 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.501073 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0a487-40d5-4df4-bbad-fd7f03c76ccc admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.506312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.506969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.507256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.507535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.508253 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.509882 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.520123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1302/2627] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:36.524480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.534145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487453c-586f-49cf-9fb7-fb9d94bbcb99 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.538769 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.539419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.539704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.539982 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.540707 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.542750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639583e-25a9-44ee-9f9d-82469d756b21 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.552929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1326/2628] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:36.557168 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.566836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce8363-d865-48f0-915d-ff4f2fb5cf8a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.571969 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.572842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.573127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.573445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] PATH_INFO: `/v3/projects/a1fa6a5cd8274b1595effaca01031da4/users/5b06c8d74aba46c38b7b11a97e3d369c/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.587760 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fa6a5cd8274b1595effaca01031da4, user_id=5b06c8d74aba46c38b7b11a97e3d369c, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.590478 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.603127 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1303/2629] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:36 2022] PUT /identity/v3/projects/a1fa6a5cd8274b1595effaca01031da4/users/5b06c8d74aba46c38b7b11a97e3d369c/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:36.613412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.613710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.613990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.639997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] MFA Rules not processed for user `5b06c8d74aba46c38b7b11a97e3d369c`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:36.641251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:36.702089 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1327/2630] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:36.706466 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.765898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44886141-7b94-4370-be49-c450a9ed9244 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.770505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.771151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.771444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.771720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.772436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.774361 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.802487 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1304/2631] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:36.803173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.813244 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4007d3-d9ea-49f3-9cc6-7e43af05f083 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.873099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.873813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.874099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.874378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.875070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.876998 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.896901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1328/2632] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:36 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:36.901063 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.911123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa47e-de49-41e4-965e-25514acb3169 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.915765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.916413 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.916697 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.916975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.917732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.919347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.931021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1305/2633] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:36.935135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.945690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260ff96-d630-483d-9e1c-87951790ea64 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:36.950368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:36.951303 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:36.951587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:36.951866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] PATH_INFO: `/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3/users/d55af8200cf74a3ab97017f778f24d5e/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:36.967176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=805ed1d3d1234a4cad213a2e349b3fa3, user_id=d55af8200cf74a3ab97017f778f24d5e, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:36.969897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:36.982330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1329/2634] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:36 2022] PUT /identity/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3/users/d55af8200cf74a3ab97017f778f24d5e/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:36.986188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:36.996292 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce110db-2dc3-49d5-ba6e-202f70a41544 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:37.053169 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:37.053854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:37.054136 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:37.054404 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:37.055108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:37.056704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319b68a-a351-4240-a444-3a458bed6f4b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:37.066107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1306/2635] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:37.070382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:37.080416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa22e-820c-4d84-b1f0-37b3e9dfbcdd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:37.085553 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:37.086423 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:37.086708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:37.086984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] PATH_INFO: `/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3/users/d55af8200cf74a3ab97017f778f24d5e/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:37.088953 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805ed1d3d1234a4cad213a2e349b3fa3, user_id=d55af8200cf74a3ab97017f778f24d5e, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:37.091674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:37.102383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1330/2636] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:37 2022] PUT /identity/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3/users/d55af8200cf74a3ab97017f778f24d5e/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:37.113091 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:37.113426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:37.113705 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:37.139641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] MFA Rules not processed for user `d55af8200cf74a3ab97017f778f24d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:37.140838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:37.205474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1307/2637] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:37.216612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:37.218334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:37.273282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea83ac6-1ed3-49a0-8baf-57d4e501ac22 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:37.276920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:37.277590 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:37.277875 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:37.278433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:37.331511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:37.332882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:37.342176 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1331/2638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:41.439750 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:41.450146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3d4f-cc4c-4b40-82f0-fdeb3c49afd3 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:41.453733 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:41.454362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:41.454668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:41.454939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:41.463594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:41.465004 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdaffe-e35a-41b5-af3f-2fcbafe57269 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:41.474504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1308/2639] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:46.289972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:46.349605 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b6bd-0aba-4204-98bd-f681496d8bf7 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:46.354562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:46.355414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:46.355699 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:46.355970 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] PATH_INFO: `/v3/users/5b06c8d74aba46c38b7b11a97e3d369c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:46.357128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b06c8d74aba46c38b7b11a97e3d369c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:46.359077 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:46.403639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b06c8d74aba46c38b7b11a97e3d369c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.410468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b06c8d74aba46c38b7b11a97e3d369c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.417751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b06c8d74aba46c38b7b11a97e3d369c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.418359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b06c8d74aba46c38b7b11a97e3d369c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.429712 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b06c8d74aba46c38b7b11a97e3d369c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.435442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1332/2640] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:46 2022] DELETE /identity/v3/users/5b06c8d74aba46c38b7b11a97e3d369c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:46.439936 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:46.440395 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:46.440491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:46.457683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:46.458881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:46.516995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1309/2641] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:46.527194 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:46.528617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:46.584444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f0d6-c719-4d27-9882-55dc2ff7c8d7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:46.589087 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:46.589764 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:46.590051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:46.590329 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:46.599337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:46.600831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:46.610679 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1333/2642] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:46.871362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:46.872805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:46.887749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00e13-2129-4ae3-a5a3-ce2d58614763 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:46.893355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:46.894341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:46.894647 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:46.894878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] PATH_INFO: `/v3/projects/a1fa6a5cd8274b1595effaca01031da4` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:46.896097 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fa6a5cd8274b1595effaca01031da4)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:46.898308 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:46.947464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fa6a5cd8274b1595effaca01031da4', 'request_id': 'req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.953221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fa6a5cd8274b1595effaca01031da4', 'request_id': 'req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.959734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fa6a5cd8274b1595effaca01031da4', 'request_id': 'req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.971053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] The token cache is being invalidate because project a1fa6a5cd8274b1595effaca01031da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:46.971340 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.971955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:46.973520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1310/2643] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:46 2022] DELETE /identity/v3/projects/a1fa6a5cd8274b1595effaca01031da4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:46.977672 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:46.987116 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc87f-f71c-4ed9-8097-cf9c03d4ed95 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.041497 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.042364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.042647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.042922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] PATH_INFO: `/v3/users/d55af8200cf74a3ab97017f778f24d5e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.044114 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55af8200cf74a3ab97017f778f24d5e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.046079 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.088934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55af8200cf74a3ab97017f778f24d5e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.095475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55af8200cf74a3ab97017f778f24d5e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.102608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55af8200cf74a3ab97017f778f24d5e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.103390 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55af8200cf74a3ab97017f778f24d5e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.115063 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d7ac6c5b-649f-4e29-9ba9-59b7490cf7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55af8200cf74a3ab97017f778f24d5e'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.120744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1334/2644] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:26:46 2022] DELETE /identity/v3/users/d55af8200cf74a3ab97017f778f24d5e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:47.392672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.397468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:47.411541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cfb5f-1e5c-4744-8bb2-1a2d23c3a7dc admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.472351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.473229 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.473524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.473801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] PATH_INFO: `/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.474972 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=805ed1d3d1234a4cad213a2e349b3fa3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.477604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.520785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805ed1d3d1234a4cad213a2e349b3fa3', 'request_id': 'req-7efecccd-6afe-4e29-8946-a66a314e29dd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.526473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805ed1d3d1234a4cad213a2e349b3fa3', 'request_id': 'req-7efecccd-6afe-4e29-8946-a66a314e29dd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.533273 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805ed1d3d1234a4cad213a2e349b3fa3', 'request_id': 'req-7efecccd-6afe-4e29-8946-a66a314e29dd'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.544327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] The token cache is being invalidate because project 805ed1d3d1234a4cad213a2e349b3fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:26:47.544613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.545258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-7efecccd-6afe-4e29-8946-a66a314e29dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:26:47.546773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1311/2645] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:26:47 2022] DELETE /identity/v3/projects/805ed1d3d1234a4cad213a2e349b3fa3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:47.553924 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.554465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.554465 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.572710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:47.574367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:47.630143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1335/2646] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:47.639243 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.639471 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.639780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.658120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:47.659313 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:47.667083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1312/2647] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:47.671129 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.680500 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a531-aef7-4466-9f82-9280de1c9809 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.685006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.685683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.685968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.686243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.686959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:26:47.687265 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.688853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.700335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1336/2648] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:26:47.704582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.714257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901463f4-f93f-4460-84b5-b5b1b1f4d40e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.718864 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.719500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.719782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.720056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.720764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.722683 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.746636 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1313/2649] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:26:47 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:47.750619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.761614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cc9b0-e776-420d-acff-d72880c5c8f7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.814636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.815296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.815578 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.815850 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.816537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.818479 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.838580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1337/2650] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:26:47 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:26:47.842475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.852745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da460d-d8b6-4bcb-9f83-a5f2985dccda admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.857311 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.857954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.858232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.858505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.859223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.860797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.871108 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1314/2651] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:47.875016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.885362 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6129-b2ab-4ca6-b745-f9029eae4111 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.890306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.890897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.891182 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.891463 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.892190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.893842 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb211f3-6f33-40b4-91fe-cbcd4ba1832f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.904665 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1338/2652] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:26:47.908619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:47.918335 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8551a-4f6c-45ce-8bb4-b51f9c9dc58a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:47.922934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:47.923795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.924077 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.924352 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] PATH_INFO: `/v3/projects/bf7cbb5bfccf4ed7bd5f19795aa85a24/users/507bdb7faf884b53b9fd8ef247cac5d3/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.939050 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7cbb5bfccf4ed7bd5f19795aa85a24, user_id=507bdb7faf884b53b9fd8ef247cac5d3, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:47.941756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:47.956256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1315/2653] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:26:47 2022] PUT /identity/v3/projects/bf7cbb5bfccf4ed7bd5f19795aa85a24/users/507bdb7faf884b53b9fd8ef247cac5d3/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:26:47.968294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:47.968587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:47.968866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:47.995666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] MFA Rules not processed for user `507bdb7faf884b53b9fd8ef247cac5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:47.996908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:48.059721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1339/2654] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:26:48.071087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:48.072752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:48.128042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eee41-78f9-454a-9f20-f30abfd48f2c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:48.131690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:48.132321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:48.132601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:48.132875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:48.141442 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:48.142811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b854379-e485-4b69-b229-7be7130260d3 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:48.151884 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1316/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:26:49.208706 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:26:49.210214 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:49.224193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1561e29-47ed-4461-a82e-ac65f523aef4 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:26:49.229173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:26:49.229997 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:49.230358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:49.230654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:49.233498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:49.299638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:26:49.301133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbdf7a-d9d9-42b5-bc2e-d22947f2cdbf service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:26:49.311294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1340/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:26:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:26:59.247939 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:26:59.248481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:26:59.248481 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:26:59.265635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] MFA Rules not processed for user `2b7f4e19dcdf475bb44bb51597281a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:26:59.266834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:26:59.273605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1317/2657] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:14.741475 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:14.742633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:14.742928 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:14.760727 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] MFA Rules not processed for user `e9e915bc5c604cfcb8662167332f6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:14.762014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:14.828762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1341/2658] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:16.031338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:16.032726 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:16.105002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6c682-95da-48f2-8080-a12312ad36a9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:16.110019 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:16.110679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:16.110965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:16.111238 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:16.113064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:16.125341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:16.126897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db02e95-7786-461e-8f61-4bfada44ee16 service placement] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:16.136732 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1318/2659] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:16.467871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:16.469352 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:16.534356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b43b48-9f54-4a2d-aca8-b68eae62554c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:16.538815 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:16.539688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:16.539980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:16.540864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] PATH_INFO: `/v3/users/f9ec114058fc4489a6b7d6f1bc9bc2f1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:16.542092 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ec114058fc4489a6b7d6f1bc9bc2f1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:16.544050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:16.591455 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ec114058fc4489a6b7d6f1bc9bc2f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:16.598330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ec114058fc4489a6b7d6f1bc9bc2f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:16.606480 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ec114058fc4489a6b7d6f1bc9bc2f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:16.607139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ec114058fc4489a6b7d6f1bc9bc2f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:16.620262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ec114058fc4489a6b7d6f1bc9bc2f1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:16.627119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1342/2660] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:16 2022] DELETE /identity/v3/users/f9ec114058fc4489a6b7d6f1bc9bc2f1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:16.631860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:16.632145 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:16.632418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:16.662765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:16.664006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:16.738854 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1319/2661] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:16.749149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:16.750767 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:16.819078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f34bcb-26e8-4d34-a657-5951fae3d70f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:16.823734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:16.827518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:16.827518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:16.827518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:16.839273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:16.840762 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:16.850910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1343/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:27:17.154852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:17.156459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:17.183563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4a54-7811-4932-8f59-114c0b83de56 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:17.189679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:17.190681 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:17.191295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:17.192893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] PATH_INFO: `/v3/projects/85551c72475b416fab9d515a98be00b6` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:17.194223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=85551c72475b416fab9d515a98be00b6)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:17.196921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:17.247469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85551c72475b416fab9d515a98be00b6', 'request_id': 'req-0c028313-c12d-444f-a69a-f3a83b595fdb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.255491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85551c72475b416fab9d515a98be00b6', 'request_id': 'req-0c028313-c12d-444f-a69a-f3a83b595fdb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.264836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85551c72475b416fab9d515a98be00b6', 'request_id': 'req-0c028313-c12d-444f-a69a-f3a83b595fdb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.276575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] The token cache is being invalidate because project 85551c72475b416fab9d515a98be00b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:17.276867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.277521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.279074 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1320/2663] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:17 2022] DELETE /identity/v3/projects/85551c72475b416fab9d515a98be00b6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:17.283193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:17.294931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38be98-394e-4731-9a6f-932e6c8d727c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:17.358172 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:17.359060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:17.359345 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:17.359810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] PATH_INFO: `/v3/users/637fc4650e8c4bf9a4fa7f9b78693258` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:17.361039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637fc4650e8c4bf9a4fa7f9b78693258)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:17.363019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:17.418777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637fc4650e8c4bf9a4fa7f9b78693258'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.427144 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637fc4650e8c4bf9a4fa7f9b78693258'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.438512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637fc4650e8c4bf9a4fa7f9b78693258'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.440365 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637fc4650e8c4bf9a4fa7f9b78693258'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.478716 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-bf660d0e-8325-4778-b2f7-1d30396b8494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637fc4650e8c4bf9a4fa7f9b78693258'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:17.500778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1344/2664] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:17 2022] DELETE /identity/v3/users/637fc4650e8c4bf9a4fa7f9b78693258 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:18.204542 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.206807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:18.236106 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c028313-c12d-444f-a69a-f3a83b595fdb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.295876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.296722 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.297024 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.297307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] PATH_INFO: `/v3/projects/4919ffc8eccb493f8e1a02240da3742d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.298688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4919ffc8eccb493f8e1a02240da3742d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.301698 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.360872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4919ffc8eccb493f8e1a02240da3742d', 'request_id': 'req-cb4c6c30-1a35-4676-a804-b3c32cfd7201'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:18.366641 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4919ffc8eccb493f8e1a02240da3742d', 'request_id': 'req-cb4c6c30-1a35-4676-a804-b3c32cfd7201'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:18.390114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4919ffc8eccb493f8e1a02240da3742d', 'request_id': 'req-cb4c6c30-1a35-4676-a804-b3c32cfd7201'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:18.408451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] The token cache is being invalidate because project 4919ffc8eccb493f8e1a02240da3742d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:18.409680 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:18.410389 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-cb4c6c30-1a35-4676-a804-b3c32cfd7201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:18.412347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1321/2665] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:18 2022] DELETE /identity/v3/projects/4919ffc8eccb493f8e1a02240da3742d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:18.420238 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.421163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.421163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.441501 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:18.442823 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:18.527262 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1345/2666] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:18.536256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.538239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.538239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.567200 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:18.568463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:18.579154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1322/2667] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:18.583527 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.602294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5182c-fa05-4e90-9b45-ec99a744bcf2 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.608809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.609859 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.610336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.610791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.611951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:27:18.612422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.614478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.646426 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1346/2668] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:27:18.647909 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.658519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a401285-f5b9-4957-b975-d2635ad6314e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.663472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.664152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.664437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.664714 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.665519 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.667479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.695754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1323/2669] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:18 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:18.700540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.711595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363fde-f044-4b71-b145-235a9ed858a4 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.773023 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.773735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.774017 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.774433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.775281 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.777631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.799504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1347/2670] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:18 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:27:18.806305 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.817805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e999e-6957-42c8-adae-1b347ef358e9 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.825808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.826582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.826866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.827138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.827861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.829510 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.842649 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1324/2671] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:18.846648 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.865379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad282-7008-4040-8deb-cdad8b930440 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.871336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.871967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.872623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.872623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.873280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.874910 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629999d-e5eb-4dda-8ebd-5f9114161016 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.889317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1348/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:18.893567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:18.903887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81a5a-da48-47c1-95b6-b51746fcc9f6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:18.908662 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:18.909673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.910022 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.910366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] PATH_INFO: `/v3/projects/0241d24b589240e7bb8197fd824cc160/users/5ab9c7ff6e8b4ac398bb9dda9687a364/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.926379 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0241d24b589240e7bb8197fd824cc160, user_id=5ab9c7ff6e8b4ac398bb9dda9687a364, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:18.929100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:18.943104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1325/2673] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:18 2022] PUT /identity/v3/projects/0241d24b589240e7bb8197fd824cc160/users/5ab9c7ff6e8b4ac398bb9dda9687a364/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:18.954382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:18.954674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:18.954959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:18.983018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] MFA Rules not processed for user `5ab9c7ff6e8b4ac398bb9dda9687a364`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:18.983018 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:19.049937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1349/2674] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:19.054436 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.128227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4f259-e6e2-43c1-9f0f-9864365443f1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.132771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.133458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.134290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.134566 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.135276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.137159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.162811 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1326/2675] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:19 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:19.169702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.180580 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552a28d-8736-49d7-9b1d-4168f398379a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.238774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.239588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.239709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.240034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.240785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.242729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.267833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1350/2676] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:19 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:19.269075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.280342 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36d094-7954-4053-805e-2c920dfb5d2c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.293664 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.294665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.295153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.295445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.296154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.298016 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.309150 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1327/2677] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:19.313273 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.324336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cc8b9-7ac3-459f-bae7-55de6f11ffe9 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.329322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.330233 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.330517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.330791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] PATH_INFO: `/v3/projects/ab4cdada00bb412292a7f8558334c25f/users/4e4362c608f34782a7a8f58f453a9801/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.349702 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4cdada00bb412292a7f8558334c25f, user_id=4e4362c608f34782a7a8f58f453a9801, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.352566 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.366072 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1351/2678] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:19 2022] PUT /identity/v3/projects/ab4cdada00bb412292a7f8558334c25f/users/4e4362c608f34782a7a8f58f453a9801/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:19.371970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.382249 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e495a-5ae6-41d2-89e2-b6ee87119303 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.458267 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.458948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.459227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.459505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.460277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.462020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaed9c7-8594-490c-a2ac-711b4938ae96 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.471990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1328/2679] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:19.476066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.486683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12989c3-d15d-43bb-af76-0f9a80dc5d8a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.491862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.492734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.493537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.493862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] PATH_INFO: `/v3/projects/ab4cdada00bb412292a7f8558334c25f/users/4e4362c608f34782a7a8f58f453a9801/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.495796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4cdada00bb412292a7f8558334c25f, user_id=4e4362c608f34782a7a8f58f453a9801, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.498519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.509561 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1352/2680] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:19 2022] PUT /identity/v3/projects/ab4cdada00bb412292a7f8558334c25f/users/4e4362c608f34782a7a8f58f453a9801/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:19.521064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.521390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.521671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.550687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] MFA Rules not processed for user `4e4362c608f34782a7a8f58f453a9801`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:19.551991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:19.632517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1329/2681] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:19.645193 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.647059 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:19.713067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a654c9-835f-4562-95f6-82851010db51 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.716755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.717456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.717741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.718020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.728377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.729872 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe844c7-f182-4fe5-9a25-0cdca8d6e51c service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.741607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1353/2682] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:19.768930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:19.838823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40587b-9fb1-4630-b927-5813fe662ae0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:19.845878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:19.846766 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.847040 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.847318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] PATH_INFO: `/v3/users/5ab9c7ff6e8b4ac398bb9dda9687a364` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.848583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab9c7ff6e8b4ac398bb9dda9687a364)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:19.850567 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:19.898627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab9c7ff6e8b4ac398bb9dda9687a364'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:19.906932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab9c7ff6e8b4ac398bb9dda9687a364'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:19.914655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab9c7ff6e8b4ac398bb9dda9687a364'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:19.915408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab9c7ff6e8b4ac398bb9dda9687a364'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:19.916011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab9c7ff6e8b4ac398bb9dda9687a364'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:19.932619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1330/2683] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:19 2022] DELETE /identity/v3/users/5ab9c7ff6e8b4ac398bb9dda9687a364 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:19.936946 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:19.937277 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:19.937563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:19.957395 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:19.958701 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:20.020378 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1354/2684] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:20.029986 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:20.031414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:20.090572 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2850-1006-4677-b220-840772289862 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:20.094268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:20.094917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:20.095198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:20.095474 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:20.104795 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:20.106256 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:20.115505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1331/2685] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:20.391573 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:20.392999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:20.411907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518af7b-0921-4446-90e3-026a9f711505 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:20.417433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:20.418280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:20.418568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:20.419481 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] PATH_INFO: `/v3/projects/0241d24b589240e7bb8197fd824cc160` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:20.421391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0241d24b589240e7bb8197fd824cc160)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:20.423556 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:20.497575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0241d24b589240e7bb8197fd824cc160', 'request_id': 'req-b79eaf9e-77c6-4a55-b24f-95882743acfb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.497575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0241d24b589240e7bb8197fd824cc160', 'request_id': 'req-b79eaf9e-77c6-4a55-b24f-95882743acfb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.502583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0241d24b589240e7bb8197fd824cc160', 'request_id': 'req-b79eaf9e-77c6-4a55-b24f-95882743acfb'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.518379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] The token cache is being invalidate because project 0241d24b589240e7bb8197fd824cc160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:20.518673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.519315 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.524302 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1355/2686] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:20 2022] DELETE /identity/v3/projects/0241d24b589240e7bb8197fd824cc160 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:20.526115 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:20.538276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab082df-6f23-49fb-b1bf-5a1b081425d1 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:20.599905 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:20.600927 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:20.601408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:20.601702 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] PATH_INFO: `/v3/users/4e4362c608f34782a7a8f58f453a9801` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:20.602995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4362c608f34782a7a8f58f453a9801)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:20.605144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:20.656616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4362c608f34782a7a8f58f453a9801'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.667451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4362c608f34782a7a8f58f453a9801'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.676729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4362c608f34782a7a8f58f453a9801'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.677548 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4362c608f34782a7a8f58f453a9801'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.678309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-c4b12d11-8453-4965-b2c2-eea0408db5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4362c608f34782a7a8f58f453a9801'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:20.699797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1332/2687] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:20 2022] DELETE /identity/v3/users/4e4362c608f34782a7a8f58f453a9801 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:21.050942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.052460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:21.079230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eaf9e-77c6-4a55-b24f-95882743acfb admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.138588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.139461 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.139747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.140024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] PATH_INFO: `/v3/projects/ab4cdada00bb412292a7f8558334c25f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.141254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4cdada00bb412292a7f8558334c25f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.143275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.202223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4cdada00bb412292a7f8558334c25f', 'request_id': 'req-b1610e2b-40c3-4f54-964f-3562f1f4fac8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:21.208661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4cdada00bb412292a7f8558334c25f', 'request_id': 'req-b1610e2b-40c3-4f54-964f-3562f1f4fac8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:21.215746 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4cdada00bb412292a7f8558334c25f', 'request_id': 'req-b1610e2b-40c3-4f54-964f-3562f1f4fac8'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:21.231608 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] The token cache is being invalidate because project ab4cdada00bb412292a7f8558334c25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:21.231901 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:21.232559 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-b1610e2b-40c3-4f54-964f-3562f1f4fac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:21.234178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1356/2688] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:21 2022] DELETE /identity/v3/projects/ab4cdada00bb412292a7f8558334c25f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:21.239242 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.239541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.239851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.260202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:21.262272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:21.328392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1333/2689] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:27:21.335240 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.335617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.335952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.356341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:21.357583 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:21.365811 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1357/2690] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:21.370828 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.380656 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6debe-0bc8-4a4c-b1dd-03f447f9d980 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.385902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.386570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.386851 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.387130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.387960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:27:21.388539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.390163 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.404042 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1334/2691] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:27:21.407013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.416184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110feec-77b6-4b35-b9c4-dcfbc095891f None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.420904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.421643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.421929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.422206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.422903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.424829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.453914 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1358/2692] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:27:21.455039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.465643 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69a6c-b379-4aa1-95e4-6566f0746610 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.522855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.523544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.525082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.525082 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.525419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.527366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.551497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1335/2693] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:27:21.552745 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.563147 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731657f1-24be-43dd-8a81-26ae7194218c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.567869 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.568540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.568827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.569217 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.569987 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.572191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.594249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1359/2694] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:21.597878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.609281 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6264-c92c-4e80-8eef-a25c7b330c56 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.614236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.614912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.615218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.615499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.616232 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.618800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8319de03-52c3-4f2b-81cf-866ccf1e8275 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.630692 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1336/2695] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:21.635644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.646181 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6ee97-1e3e-46d6-8124-54b6e074be34 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.651027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.651981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.652338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.652736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] PATH_INFO: `/v3/projects/772a7266faa9434d877a518ffb14b705/users/77f6b227c0ce480db6a96b9793b6b528/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.668261 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772a7266faa9434d877a518ffb14b705, user_id=77f6b227c0ce480db6a96b9793b6b528, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.671000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.685585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1360/2696] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:21 2022] PUT /identity/v3/projects/772a7266faa9434d877a518ffb14b705/users/77f6b227c0ce480db6a96b9793b6b528/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:21.696814 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.697107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.697416 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.725144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] MFA Rules not processed for user `77f6b227c0ce480db6a96b9793b6b528`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:21.726489 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:21.802418 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1337/2697] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:21.804655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.875117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c139eb-7a80-4be2-bf34-99e95fa24f21 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.879931 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.880647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.880938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.881312 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.882007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.884031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:21.914691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1361/2698] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:21.917089 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:21.928325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acac85-5c3e-4775-a489-b7718e95dbda None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:21.992130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:21.992730 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:21.993012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:21.993317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:21.994046 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:21.995988 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.020018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1338/2699] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:21 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:27:22.021418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.033124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8180-d20f-4f7c-97c4-0bb499965b8f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.039178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.040070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.040538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.040944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.041965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.044051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.055543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1362/2700] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:22.059788 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.070356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ad5e-6192-4b9f-8bcb-5448140c737f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.075798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.076667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.076947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.077240 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] PATH_INFO: `/v3/projects/a5043346c42b48b18d16686fa46e9859/users/6d82609be75440e0bf20eba96d82ab14/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.094010 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5043346c42b48b18d16686fa46e9859, user_id=6d82609be75440e0bf20eba96d82ab14, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.096874 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.116852 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1339/2701] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:22 2022] PUT /identity/v3/projects/a5043346c42b48b18d16686fa46e9859/users/6d82609be75440e0bf20eba96d82ab14/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:22.126666 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.137469 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea49e2-f70a-4ce3-8767-20ca8ad2b300 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.200601 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.201344 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.201650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.201929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.202682 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.204282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28784cf0-b7ad-46bc-a4e9-57f59c13d73b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.215015 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1363/2702] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:22.219195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.229741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2e01-2840-46f9-b3bf-8e63b9c1c80c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.234549 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.235433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.235712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.235990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] PATH_INFO: `/v3/projects/a5043346c42b48b18d16686fa46e9859/users/6d82609be75440e0bf20eba96d82ab14/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.238001 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5043346c42b48b18d16686fa46e9859, user_id=6d82609be75440e0bf20eba96d82ab14, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.240652 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.252279 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1340/2703] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:22 2022] PUT /identity/v3/projects/a5043346c42b48b18d16686fa46e9859/users/6d82609be75440e0bf20eba96d82ab14/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:27:22.264158 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.264791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.264791 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.293301 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] MFA Rules not processed for user `6d82609be75440e0bf20eba96d82ab14`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:22.294537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:22.362725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1364/2704] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:22.374792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.376645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:22.440109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badd34f-6976-42af-b880-8e57841f8d0a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.443794 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.444535 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.444816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.445184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.457398 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.458842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.468699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1341/2705] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:22.514623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:22.516121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:22.528029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d732cf-ae05-4e96-bb00-11b88327cd06 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:22.531813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:22.532552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:22.532848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:22.533124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:22.590247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:22.591731 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aee3c8-7a9c-4e21-a1c8-69ba6bf05901 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:22.601166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1365/2706] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:25.879245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:25.939370 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024707-631c-4148-9654-6cf924c36eee service cinder] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:25.943898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:25.944787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:25.945071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:25.945393 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] PATH_INFO: `/v3/users/77f6b227c0ce480db6a96b9793b6b528` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:25.947061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f6b227c0ce480db6a96b9793b6b528)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:25.948979 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:25.994807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f6b227c0ce480db6a96b9793b6b528'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.001786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f6b227c0ce480db6a96b9793b6b528'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.008900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f6b227c0ce480db6a96b9793b6b528'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.009571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f6b227c0ce480db6a96b9793b6b528'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.010197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f6b227c0ce480db6a96b9793b6b528'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.027715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1342/2707] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:25 2022] DELETE /identity/v3/users/77f6b227c0ce480db6a96b9793b6b528 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:26.032185 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:26.032639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:26.032759 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:26.050906 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:26.052109 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:26.109337 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1366/2708] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:26.119782 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:26.121245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:26.176078 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500e7c-979e-456f-84a7-0443d34f19fc admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:26.179856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:26.181293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:26.181578 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:26.181881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:26.190673 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:26.192094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:26.202017 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1343/2709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 22:27:26.461416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:26.462975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:26.474879 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62fcc-ecf6-4ce3-8cef-a32fdd28aa41 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:26.480100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:26.480980 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:26.481290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:26.481562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] PATH_INFO: `/v3/projects/772a7266faa9434d877a518ffb14b705` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:26.482749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=772a7266faa9434d877a518ffb14b705)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:26.484698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:26.529099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772a7266faa9434d877a518ffb14b705', 'request_id': 'req-c623ed4a-47cb-4ad8-8089-c8c15568b65c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.534965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772a7266faa9434d877a518ffb14b705', 'request_id': 'req-c623ed4a-47cb-4ad8-8089-c8c15568b65c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.540865 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772a7266faa9434d877a518ffb14b705', 'request_id': 'req-c623ed4a-47cb-4ad8-8089-c8c15568b65c'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.552057 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] The token cache is being invalidate because project 772a7266faa9434d877a518ffb14b705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:26.552342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.552944 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.554575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1367/2710] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:26 2022] DELETE /identity/v3/projects/772a7266faa9434d877a518ffb14b705 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:26.559225 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:26.568499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f98f-9575-4911-b63a-7e5818090008 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:26.621713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:26.622585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:26.622866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:26.623142 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] PATH_INFO: `/v3/users/6d82609be75440e0bf20eba96d82ab14` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:26.624326 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d82609be75440e0bf20eba96d82ab14)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:26.626276 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:26.668140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d82609be75440e0bf20eba96d82ab14'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.674688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d82609be75440e0bf20eba96d82ab14'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.681806 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d82609be75440e0bf20eba96d82ab14'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.682414 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d82609be75440e0bf20eba96d82ab14'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.683002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-e0b02d28-788a-4144-b0f2-5a7274741f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d82609be75440e0bf20eba96d82ab14'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:26.699006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1344/2711] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:26 2022] DELETE /identity/v3/users/6d82609be75440e0bf20eba96d82ab14 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:27.016487 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.018039 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:27.033323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ed4a-47cb-4ad8-8089-c8c15568b65c admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.094935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.095655 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.095938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.096208 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] PATH_INFO: `/v3/projects/a5043346c42b48b18d16686fa46e9859` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.097410 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5043346c42b48b18d16686fa46e9859)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.099318 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.144209 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5043346c42b48b18d16686fa46e9859', 'request_id': 'req-e2f25550-d248-4ddb-9812-cb4a662b4583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.150599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5043346c42b48b18d16686fa46e9859', 'request_id': 'req-e2f25550-d248-4ddb-9812-cb4a662b4583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.155891 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5043346c42b48b18d16686fa46e9859', 'request_id': 'req-e2f25550-d248-4ddb-9812-cb4a662b4583'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.168100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] The token cache is being invalidate because project a5043346c42b48b18d16686fa46e9859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:27.168377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.168984 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-e2f25550-d248-4ddb-9812-cb4a662b4583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.170502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1368/2712] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:27 2022] DELETE /identity/v3/projects/a5043346c42b48b18d16686fa46e9859 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:27.176682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.177155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.177274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.194137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:27.195354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:27.252317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1345/2713] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:27.260388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a119-5937-446d-8c31-27339f872e8a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.260684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a119-5937-446d-8c31-27339f872e8a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.260967 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a119-5937-446d-8c31-27339f872e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.280751 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f642a119-5937-446d-8c31-27339f872e8a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:27.281995 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f642a119-5937-446d-8c31-27339f872e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:27.291238 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1369/2714] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:27.295599 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.305045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2efda8-2978-4f02-87f3-af253113242c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.310233 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.310834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.311113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.311385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.312171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:27:27.312524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.314196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.329719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1346/2715] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:27:27.330835 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a119-5937-446d-8c31-27339f872e8a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.340544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a119-5937-446d-8c31-27339f872e8a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.345798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.346396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.346664 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.346935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.347633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.349574 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.375019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1370/2716] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:27:27.379472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.391634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb43545-7bed-4f83-a16b-74aeb5f14020 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.444724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.445444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.445748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.446537 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.447218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.449124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.471327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1347/2717] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:27.472560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.482737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce69377-e392-492e-8b31-da37ab3bf140 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.487331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.487983 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.488264 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.488540 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.489299 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.490902 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.500894 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1371/2718] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:27.504556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.514875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af8adb-62b3-413e-ac61-5c5ba81a418f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.519385 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.520018 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.520298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.520571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.521303 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.522863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e0af4f-6036-41ef-8fc4-63b53a9e1018 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.534570 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1348/2719] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:27.538514 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.548280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e50be-a2e4-45ea-9a75-61f773619f7f admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.552895 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.553813 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.554099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.554371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] PATH_INFO: `/v3/projects/4aafd6e79f604cbe9a751e1dc91a5ff8/users/404522bae01140d189abfed45c73d12f/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.568871 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aafd6e79f604cbe9a751e1dc91a5ff8, user_id=404522bae01140d189abfed45c73d12f, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.572106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.584552 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1372/2720] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:27 2022] PUT /identity/v3/projects/4aafd6e79f604cbe9a751e1dc91a5ff8/users/404522bae01140d189abfed45c73d12f/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:27.595162 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.595457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.595738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.621745 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] MFA Rules not processed for user `404522bae01140d189abfed45c73d12f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:27.622892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:27.684635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1349/2721] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:27.695661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.697966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:27.752904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a2977-2639-470a-917c-b8977ecb3c44 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.756543 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.757179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.757493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.757768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.767235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.769473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf83ff-d022-4959-aa64-2e7ffd644c54 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.779921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1373/2722] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:27.808147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:27.868672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a7c2b-c7b2-4ec4-85a2-83d07e553afe None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:27.873261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:27.874070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.874346 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.874613 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] PATH_INFO: `/v3/users/404522bae01140d189abfed45c73d12f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.875785 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=404522bae01140d189abfed45c73d12f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:27.877725 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:27.921645 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404522bae01140d189abfed45c73d12f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.929660 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404522bae01140d189abfed45c73d12f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.936937 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404522bae01140d189abfed45c73d12f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.937589 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404522bae01140d189abfed45c73d12f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.938194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404522bae01140d189abfed45c73d12f'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:27.955711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1350/2723] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:27 2022] DELETE /identity/v3/users/404522bae01140d189abfed45c73d12f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:27.960174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:27.960539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:27.960887 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:27.979121 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:27.980327 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:28.037636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1374/2724] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:27:28.049602 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.051052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:28.114754 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ca94b-366a-47f2-bc94-c04a421b15fb admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.119121 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.119773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.120056 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.120332 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.130069 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.131524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163af765-b94f-4b1b-b517-7ec386a7b64b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.142390 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1351/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:28.413845 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.415937 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:28.434952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853551d-b730-4975-8c4a-a33c7db35f7a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.444343 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.445326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.445833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.446197 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] PATH_INFO: `/v3/projects/4aafd6e79f604cbe9a751e1dc91a5ff8` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.447485 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aafd6e79f604cbe9a751e1dc91a5ff8)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.449565 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.496107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aafd6e79f604cbe9a751e1dc91a5ff8', 'request_id': 'req-a654c9d9-6b95-48e1-ae52-7ceed109a34a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:28.502377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aafd6e79f604cbe9a751e1dc91a5ff8', 'request_id': 'req-a654c9d9-6b95-48e1-ae52-7ceed109a34a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:28.508128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aafd6e79f604cbe9a751e1dc91a5ff8', 'request_id': 'req-a654c9d9-6b95-48e1-ae52-7ceed109a34a'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:28.521231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] The token cache is being invalidate because project 4aafd6e79f604cbe9a751e1dc91a5ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:28.521542 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:28.522173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a654c9d9-6b95-48e1-ae52-7ceed109a34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:28.523874 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1375/2726] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:28 2022] DELETE /identity/v3/projects/4aafd6e79f604cbe9a751e1dc91a5ff8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:28.529479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.529982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.530319 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.548288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:28.549609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:28.607353 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1352/2727] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:28.614838 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.615135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.615419 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.635010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:28.636220 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:28.644432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1376/2728] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:28.648701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.659262 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c19dc8-1c6c-44bd-b3f1-d75932fc3ebb None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.663797 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.664479 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.665459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.665738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.666455 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:27:28.666756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.668347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.679547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1353/2729] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:27:28.683750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.692829 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065aa2d-2f3c-4d9f-839b-5d9ad1886756 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.697607 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.698270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.698546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.698821 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.699526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.701452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.727749 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1377/2730] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:28.731873 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.741810 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a239f5-d9ec-4188-861a-72ab58fc013c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.796894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.797891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.798358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.798634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.799314 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.801261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.822076 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1354/2731] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:27:28 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:27:28.826460 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.836892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcc0e-aaa0-4572-a87e-caeff56bd545 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.841855 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.842512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.842799 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.843070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.843792 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.845544 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.856377 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1378/2732] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:28.860408 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.870771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537272-eef0-400c-a927-fd5179123f65 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.875382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.876041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.876318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.876593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.877345 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.878926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f3def-11ac-4ba9-b72b-1363a1f5e8c0 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.888834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1355/2733] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:27:28.892852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:28.902711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300668f0-a2d2-4999-a549-5a4ddd7252c2 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:28.908293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:28.909630 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.909882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.910360 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] PATH_INFO: `/v3/projects/e1072404daa046bbbc2b040061413e28/users/10e1b27a32174e2cbc9fdbe5b584457d/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.925324 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1072404daa046bbbc2b040061413e28, user_id=10e1b27a32174e2cbc9fdbe5b584457d, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:28.928034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:28.941257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1379/2734] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:27:28 2022] PUT /identity/v3/projects/e1072404daa046bbbc2b040061413e28/users/10e1b27a32174e2cbc9fdbe5b584457d/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:27:28.951315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:28.951690 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:28.952032 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:28.978595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] MFA Rules not processed for user `10e1b27a32174e2cbc9fdbe5b584457d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:28.979808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:29.050146 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1356/2735] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:27:29.060976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:29.062750 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:29.123374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf779-7b87-4538-8b3b-b4d137e165e5 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:29.127492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:29.128260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:29.128613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:29.129175 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:29.143951 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:29.146478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbab69-4076-48ae-9286-9e551b9c1f8e service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:29.160313 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1380/2736] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:37.562384 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:37.623198 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da49a5-470e-4c82-84d2-6dbcd466076c None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:37.627689 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:37.628552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:37.628836 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:37.629107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] PATH_INFO: `/v3/users/10e1b27a32174e2cbc9fdbe5b584457d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:37.630369 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e1b27a32174e2cbc9fdbe5b584457d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:37.632312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:37.674981 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e1b27a32174e2cbc9fdbe5b584457d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:37.681192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e1b27a32174e2cbc9fdbe5b584457d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:37.688205 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e1b27a32174e2cbc9fdbe5b584457d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:37.688813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e1b27a32174e2cbc9fdbe5b584457d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:37.689425 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e1b27a32174e2cbc9fdbe5b584457d'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:37.706301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1357/2737] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:37 2022] DELETE /identity/v3/users/10e1b27a32174e2cbc9fdbe5b584457d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:37.710853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:37.711396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:37.711396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:37.733502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:37.734729 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:37.790380 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1381/2738] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:27:37.800504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:37.801973 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:37.857655 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfaafc-421e-4608-be32-6f8478d2c08f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:37.861307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:37.861951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:37.862228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:37.862499 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:37.871762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:37.873177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:37.882296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1358/2739] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:38.139588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:38.141439 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:38.155305 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db41f6-e532-4adc-b7d4-48ed8c2e9b7a None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:38.160162 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:38.161155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:38.161478 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:38.161757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] PATH_INFO: `/v3/projects/e1072404daa046bbbc2b040061413e28` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:38.162985 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1072404daa046bbbc2b040061413e28)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:38.164959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:38.209817 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1072404daa046bbbc2b040061413e28', 'request_id': 'req-0e4d39af-7323-4861-bb4a-060a9a8483ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.216321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1072404daa046bbbc2b040061413e28', 'request_id': 'req-0e4d39af-7323-4861-bb4a-060a9a8483ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.221703 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1072404daa046bbbc2b040061413e28', 'request_id': 'req-0e4d39af-7323-4861-bb4a-060a9a8483ab'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.234000 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] The token cache is being invalidate because project e1072404daa046bbbc2b040061413e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:38.234288 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.234900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-0e4d39af-7323-4861-bb4a-060a9a8483ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.236414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1382/2740] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:38 2022] DELETE /identity/v3/projects/e1072404daa046bbbc2b040061413e28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:38.276144 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:38.277616 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:38.290787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2739cd-8acb-485a-b25c-ea9dd515aa56 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:38.351075 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:38.351967 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:38.352252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:38.352553 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] PATH_INFO: `/v3/users/507bdb7faf884b53b9fd8ef247cac5d3` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:38.354375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507bdb7faf884b53b9fd8ef247cac5d3)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:38.356324 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:38.406086 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507bdb7faf884b53b9fd8ef247cac5d3'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.415428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507bdb7faf884b53b9fd8ef247cac5d3'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.424143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507bdb7faf884b53b9fd8ef247cac5d3'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.425194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507bdb7faf884b53b9fd8ef247cac5d3'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.425831 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507bdb7faf884b53b9fd8ef247cac5d3'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.443261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1359/2741] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:27:38 2022] DELETE /identity/v3/users/507bdb7faf884b53b9fd8ef247cac5d3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:27:38.448368 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:38.448660 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:38.448941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:38.468837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:27:38.470099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:38.534355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1383/2742] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:27:38.543898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:38.545298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:38.599989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad7afc-4ca6-4988-a803-32348a2ac469 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:38.603823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:38.604463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:38.604748 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:38.605025 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:38.613918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:38.615344 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6de2-abe4-476a-b944-fe839dc9a16b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:38.624633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1360/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:27:38.879634 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:27:38.881180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:27:38.894249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdd8a9-9518-436c-9245-5438942ba902 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:27:38.898808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:27:38.899691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:27:38.899972 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:27:38.900243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] PATH_INFO: `/v3/projects/bf7cbb5bfccf4ed7bd5f19795aa85a24` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:27:38.902070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7cbb5bfccf4ed7bd5f19795aa85a24)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:27:38.904034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:27:38.950014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7cbb5bfccf4ed7bd5f19795aa85a24', 'request_id': 'req-7e4cfd97-24c7-40cf-a363-98fa847ca476'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.955974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7cbb5bfccf4ed7bd5f19795aa85a24', 'request_id': 'req-7e4cfd97-24c7-40cf-a363-98fa847ca476'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.961251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7cbb5bfccf4ed7bd5f19795aa85a24', 'request_id': 'req-7e4cfd97-24c7-40cf-a363-98fa847ca476'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.972849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] The token cache is being invalidate because project bf7cbb5bfccf4ed7bd5f19795aa85a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:27:38.973134 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.973864 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:27:38.975363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1384/2744] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:27:38 2022] DELETE /identity/v3/projects/bf7cbb5bfccf4ed7bd5f19795aa85a24 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:28:21.314912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:28:21.315431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:28:21.315531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:28:21.331971 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] MFA Rules not processed for user `e9e915bc5c604cfcb8662167332f6dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:28:21.333172 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:28:21.387088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1361/2745] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:28:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 22:29:07.643694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:07.645155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:07.703636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cfd97-24c7-40cf-a363-98fa847ca476 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:07.707684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:07.708364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:07.708652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:07.708929 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:07.711563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:07.781253 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:07.782698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:07.793424 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1385/2746] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:11.099354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:11.100838 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:11.155415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd0f32-120e-4aed-87e2-d3b5a937eee9 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:11.158925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:11.159559 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:11.159835 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:11.160105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:11.162155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:11.176130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:11.177597 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:11.188469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1362/2747] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:15.280285 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:15.289602 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf054d1-860d-471f-9cff-968f70dd593f service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:15.293741 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:15.294404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:15.294685 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:15.294959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:15.296725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:15.360760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:15.362239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:15.373105 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1386/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:22.081058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:22.083037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:22.096368 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb895f-e749-45ae-b134-3927a9b70ccb service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:22.100903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:22.102011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:22.102809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:22.103090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] PATH_INFO: `/v3/users/2b7f4e19dcdf475bb44bb51597281a43` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:22.104334 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7f4e19dcdf475bb44bb51597281a43)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:22.106298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:22.161926 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7f4e19dcdf475bb44bb51597281a43'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.170461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7f4e19dcdf475bb44bb51597281a43'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.177187 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7f4e19dcdf475bb44bb51597281a43'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.177859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7f4e19dcdf475bb44bb51597281a43'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.178463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7f4e19dcdf475bb44bb51597281a43'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.195388 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1363/2749] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:22 2022] DELETE /identity/v3/users/2b7f4e19dcdf475bb44bb51597281a43 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:22.375270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:22.385744 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ecb45-4001-4bec-a537-0c6a1e9a8f54 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:22.457925 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:22.458782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:22.459064 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:22.459339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] PATH_INFO: `/v3/projects/dbdf2d71a8ec431a871b6561439a3199` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:22.460512 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdf2d71a8ec431a871b6561439a3199)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:22.463007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:22.507353 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdf2d71a8ec431a871b6561439a3199', 'request_id': 'req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.513107 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdf2d71a8ec431a871b6561439a3199', 'request_id': 'req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.518880 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdf2d71a8ec431a871b6561439a3199', 'request_id': 'req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.530715 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] The token cache is being invalidate because project dbdf2d71a8ec431a871b6561439a3199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:22.531010 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.531627 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.533163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1387/2750] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:22 2022] DELETE /identity/v3/projects/dbdf2d71a8ec431a871b6561439a3199 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:22.537087 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:22.538525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:22.551898 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004798-c616-4496-9dc8-45e57461d54b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:22.604339 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:22.605219 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:22.605495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:22.605765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] PATH_INFO: `/v3/users/5b6086c8605c401986cb65ef7db9a749` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:22.606917 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6086c8605c401986cb65ef7db9a749)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:22.608816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:22.651538 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6086c8605c401986cb65ef7db9a749'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.658991 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6086c8605c401986cb65ef7db9a749'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.665587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6086c8605c401986cb65ef7db9a749'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.666202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6086c8605c401986cb65ef7db9a749'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.666789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6086c8605c401986cb65ef7db9a749'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.682911 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1364/2751] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:22 2022] DELETE /identity/v3/users/5b6086c8605c401986cb65ef7db9a749 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:22.869862 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:22.871396 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:22.885020 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a4a4-d37a-4f39-9fd7-987dd77ee25b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:22.939711 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:22.940567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:22.940852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:22.941130 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] PATH_INFO: `/v3/projects/c5c8dffbd780407dba917abeb6f69aa5` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:22.942336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c8dffbd780407dba917abeb6f69aa5)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:22.944250 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:22.987758 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c8dffbd780407dba917abeb6f69aa5', 'request_id': 'req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.993653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c8dffbd780407dba917abeb6f69aa5', 'request_id': 'req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:22.998888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c8dffbd780407dba917abeb6f69aa5', 'request_id': 'req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:23.010464 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] The token cache is being invalidate because project c5c8dffbd780407dba917abeb6f69aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:23.010754 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:23.011370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:23.012893 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1388/2752] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:22 2022] DELETE /identity/v3/projects/c5c8dffbd780407dba917abeb6f69aa5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:27.554800 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:27.556449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:27.570659 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3e52-7198-4a77-b9cd-bccf8756f7c7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:27.624895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:27.625791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:27.626070 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:27.626343 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] PATH_INFO: `/v3/users/e9e915bc5c604cfcb8662167332f6dbc` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:27.627513 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e915bc5c604cfcb8662167332f6dbc)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:27.629458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:27.672807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e915bc5c604cfcb8662167332f6dbc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:27.679507 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e915bc5c604cfcb8662167332f6dbc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:27.686105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e915bc5c604cfcb8662167332f6dbc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:27.686669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e915bc5c604cfcb8662167332f6dbc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:27.687330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b17c7aa4-abd0-4cbb-85b7-538bf5daa2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e915bc5c604cfcb8662167332f6dbc'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:27.703965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1365/2753] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:27 2022] DELETE /identity/v3/users/e9e915bc5c604cfcb8662167332f6dbc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:27.874165 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:27.875688 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:27.889441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976ed5b-7b45-4354-ad53-cc4e9d8312e3 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:27.945050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:27.946440 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:27.946725 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:27.947048 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] PATH_INFO: `/v3/projects/1fdb1e1a694045db8aba7380ea8d66f6` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:27.948260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdb1e1a694045db8aba7380ea8d66f6)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:27.950251 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:27.994614 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdb1e1a694045db8aba7380ea8d66f6', 'request_id': 'req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:28.000493 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdb1e1a694045db8aba7380ea8d66f6', 'request_id': 'req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:28.005833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdb1e1a694045db8aba7380ea8d66f6', 'request_id': 'req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:28.017774 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] The token cache is being invalidate because project 1fdb1e1a694045db8aba7380ea8d66f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:28.018066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:28.018683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-47f4b8c4-4858-4d1b-b7bb-f92b10f3a882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:28.020222 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1389/2754] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:27 2022] DELETE /identity/v3/projects/1fdb1e1a694045db8aba7380ea8d66f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:28.025955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.026251 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.026527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.044039 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:28.045258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:28.104030 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1366/2755] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:28.112355 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.112644 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.112921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.131740 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:28.132943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:28.141623 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1390/2756] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:28.145650 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.155601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b720128-0f98-4486-8c91-00db37e8fa8e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.160451 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.161090 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.161401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.161677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.162440 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:28.162741 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.164320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.175525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1367/2757] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 22:29:28.179546 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.188445 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c756cb-d3ae-41b0-becd-8c1c12246ee0 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.193028 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.193694 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.193976 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.194245 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.194920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.197336 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.221584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1391/2758] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:28 2022] POST /identity/v3/projects => generated 403 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:28.225634 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.235665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd7579-facf-4feb-8e58-bb39ebd6fa14 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.290235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.290913 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.291196 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.291464 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.292143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.294157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.314611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1368/2759] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:28 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:28.318673 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.330757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226546-98ed-4246-a308-6a88d0739bfc admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.336681 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.337563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.338025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.338407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.339356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.341128 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.352122 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1392/2760] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:28.355669 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.365631 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc422-713c-4b19-a40a-2f6a07550def admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.370757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.371402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.371682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.371955 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.372667 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.374277 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5afcd-8923-4f59-8346-e4a75d11a215 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.384734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1369/2761] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:28.388915 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.398717 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136f4d7-ad0c-4e42-b36a-0579bc1fdc47 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.403340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.404230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.404513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.404789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] PATH_INFO: `/v3/projects/e4b9090f6b2249cab900b109fc2bccf1/users/3b56f585ab1f44caaa549d651596840e/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.420266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b9090f6b2249cab900b109fc2bccf1, user_id=3b56f585ab1f44caaa549d651596840e, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.422973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.435861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1393/2762] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:28 2022] PUT /identity/v3/projects/e4b9090f6b2249cab900b109fc2bccf1/users/3b56f585ab1f44caaa549d651596840e/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:28.440862 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31be0-ea42-45df-9c0e-bb3a840e04c7 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.441155 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31be0-ea42-45df-9c0e-bb3a840e04c7 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.441497 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31be0-ea42-45df-9c0e-bb3a840e04c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.459236 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-04a31be0-ea42-45df-9c0e-bb3a840e04c7 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:28.460431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-04a31be0-ea42-45df-9c0e-bb3a840e04c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:28.515531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1370/2763] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:28.525106 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:28.526806 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:28.580554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48426-db4a-4afc-8c19-c1eaa04f09f6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:28.584151 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:28.584781 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:28.585060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:28.585367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:28.594149 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:28.595575 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:28.604773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1394/2764] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:29.203315 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.203847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.203948 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.232356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] MFA Rules not processed for user `3b56f585ab1f44caaa549d651596840e`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:29.233637 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:29.300527 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1371/2765] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:29.304904 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.314757 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561056-e98d-4080-b846-31e975a4a838 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.319401 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.320066 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.320354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.320636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.321404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.323335 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.350227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1395/2766] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:29 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:29.354596 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.365367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1e788-9825-4549-9a3c-9895aed9de36 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.423064 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.424109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.424401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.424707 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.425431 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.427392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.448188 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1372/2767] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:29 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:29:29.451737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.463163 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84154-81cd-4f6b-b6bb-5b37239492f0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.468016 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.468683 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.468974 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.469289 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.470030 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.471643 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.485316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1396/2768] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:29:29.486417 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.496348 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9d80-853d-498f-9ec7-820ac49f3fd6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.501143 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.502154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.502438 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.502720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] PATH_INFO: `/v3/projects/3ba66424b22c4d968e2bfccddeb1a935/users/20e704966b6a45edb4e7e9bb538baaf1/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.518003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba66424b22c4d968e2bfccddeb1a935, user_id=20e704966b6a45edb4e7e9bb538baaf1, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.520677 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.535435 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1373/2769] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:29 2022] PUT /identity/v3/projects/3ba66424b22c4d968e2bfccddeb1a935/users/20e704966b6a45edb4e7e9bb538baaf1/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:29.539432 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.549505 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bb775-9ec4-47ce-9dda-0dd0bef29e1a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.603009 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.603675 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.603963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.604239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.604963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.606595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ed026-387f-4e9a-b34a-9206c9a6efa4 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.615920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1397/2770] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:29.620033 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:29.630312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5dba1a-2b58-4c94-b998-1bc87c665f18 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:29.635405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:29.636270 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:29.636552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:29.636826 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] PATH_INFO: `/v3/projects/3ba66424b22c4d968e2bfccddeb1a935/users/20e704966b6a45edb4e7e9bb538baaf1/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:29.639044 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba66424b22c4d968e2bfccddeb1a935, user_id=20e704966b6a45edb4e7e9bb538baaf1, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:29.641711 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:29.652177 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1374/2771] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:29 2022] PUT /identity/v3/projects/3ba66424b22c4d968e2bfccddeb1a935/users/20e704966b6a45edb4e7e9bb538baaf1/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:30.230805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:30.231141 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:30.231422 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:30.257257 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] MFA Rules not processed for user `20e704966b6a45edb4e7e9bb538baaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:30.258515 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:30.325330 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1398/2772] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:31.309331 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:31.368265 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d6911-bd61-4a79-8309-e9d09787de6a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:31.373428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:31.374288 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:31.374571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:31.374843 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] PATH_INFO: `/v3/users/3b56f585ab1f44caaa549d651596840e` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:31.376012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b56f585ab1f44caaa549d651596840e)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:31.377974 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:31.422469 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b56f585ab1f44caaa549d651596840e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.429329 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b56f585ab1f44caaa549d651596840e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.436523 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b56f585ab1f44caaa549d651596840e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.437165 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b56f585ab1f44caaa549d651596840e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.437787 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b56f585ab1f44caaa549d651596840e'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.454534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1375/2773] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:31 2022] DELETE /identity/v3/users/3b56f585ab1f44caaa549d651596840e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:31.622853 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:31.633783 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ec10-3b1a-4b05-8c90-efacafa4e5e3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:31.690810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:31.691670 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:31.691959 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:31.692237 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] PATH_INFO: `/v3/projects/e4b9090f6b2249cab900b109fc2bccf1` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:31.693447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b9090f6b2249cab900b109fc2bccf1)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:31.695413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:31.739062 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b9090f6b2249cab900b109fc2bccf1', 'request_id': 'req-f4419baf-af72-4eec-b31e-1a6a4e613624'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.745504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b9090f6b2249cab900b109fc2bccf1', 'request_id': 'req-f4419baf-af72-4eec-b31e-1a6a4e613624'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.750755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b9090f6b2249cab900b109fc2bccf1', 'request_id': 'req-f4419baf-af72-4eec-b31e-1a6a4e613624'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.762294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] The token cache is being invalidate because project e4b9090f6b2249cab900b109fc2bccf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:31.762584 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.763198 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.765004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1399/2774] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:31 2022] DELETE /identity/v3/projects/e4b9090f6b2249cab900b109fc2bccf1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:31.768965 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:31.770375 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:31.782775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659fcff-d656-45ca-83e8-f0f1acb0c89a admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:31.836583 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:31.837492 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:31.837773 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:31.838045 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] PATH_INFO: `/v3/users/20e704966b6a45edb4e7e9bb538baaf1` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:31.839290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e704966b6a45edb4e7e9bb538baaf1)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:31.841246 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:31.886213 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e704966b6a45edb4e7e9bb538baaf1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.894729 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e704966b6a45edb4e7e9bb538baaf1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.901855 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e704966b6a45edb4e7e9bb538baaf1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.902511 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e704966b6a45edb4e7e9bb538baaf1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.903116 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-32856c69-d83c-450b-a39c-16c1d94e2a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e704966b6a45edb4e7e9bb538baaf1'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:31.920310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1376/2775] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:31 2022] DELETE /identity/v3/users/20e704966b6a45edb4e7e9bb538baaf1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:32.084599 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.086180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:32.104205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4419baf-af72-4eec-b31e-1a6a4e613624 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.161115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.162042 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.162364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.162674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] PATH_INFO: `/v3/projects/3ba66424b22c4d968e2bfccddeb1a935` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.163908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba66424b22c4d968e2bfccddeb1a935)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.166526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.214206 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba66424b22c4d968e2bfccddeb1a935', 'request_id': 'req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:32.220428 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba66424b22c4d968e2bfccddeb1a935', 'request_id': 'req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:32.225939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba66424b22c4d968e2bfccddeb1a935', 'request_id': 'req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:32.238809 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] The token cache is being invalidate because project 3ba66424b22c4d968e2bfccddeb1a935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:32.239125 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:32.239733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-14ea4a5c-fc4a-457f-abd5-e0d6da24d5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:32.241283 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1400/2776] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:32 2022] DELETE /identity/v3/projects/3ba66424b22c4d968e2bfccddeb1a935 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:32.246114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.246399 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.246672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.264107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:32.265272 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:32.322218 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1377/2777] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:32.331215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.331518 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.332024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.352708 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:32.354535 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:32.362739 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1401/2778] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:32.367154 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.377093 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01983a9-c901-464a-aa92-129741f46d12 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.381699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.382347 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.382627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.382897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.383607 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:32.383912 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.386072 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.397738 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1378/2779] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:32.402437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.411652 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07eb4c-4754-4631-8aee-09eff7cc326c None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.416266 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.416900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.417180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.417490 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.418180 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.420067 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.444267 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1402/2780] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:32.448900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.458563 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921c6a-d7c6-4273-9b4b-d8e0b04102d2 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.512790 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.513483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.514037 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.514362 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.514987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.516890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.536209 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1379/2781] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:32.540229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.550321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeee39-eb35-40e4-8c1c-bb3e9f7623f6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.554812 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.555466 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.555737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.556007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.556723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.558350 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.568637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1403/2782] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:32.572833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.582569 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112db78-bfd6-43b3-85ae-2a4ef3d54449 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.587195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.588363 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.588646 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.588922 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.589674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.591254 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106623c-b298-4d54-ac46-8aea57fe3ac3 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.600771 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1380/2783] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:32.604538 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.614061 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007696-f6b5-44f9-81dd-e5286d401b91 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.618897 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.619747 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.620025 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.620296 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] PATH_INFO: `/v3/projects/e4d5e01ee7e84c26836f6f87f8b90b25/users/d1e82ad824844baa90d3b9fe9d1ab34f/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.635013 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5e01ee7e84c26836f6f87f8b90b25, user_id=d1e82ad824844baa90d3b9fe9d1ab34f, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.637777 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.652111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1404/2784] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:32 2022] PUT /identity/v3/projects/e4d5e01ee7e84c26836f6f87f8b90b25/users/d1e82ad824844baa90d3b9fe9d1ab34f/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:32.662112 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.662405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.662682 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.687679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] MFA Rules not processed for user `d1e82ad824844baa90d3b9fe9d1ab34f`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:32.688878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:32.750919 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1381/2785] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:32.755334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.815418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9767dc1-65b0-41e6-a422-92b3d98495e0 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.820136 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.820798 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.821085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.821397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.822099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.824027 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.848843 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1405/2786] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:32.852959 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.864301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c528de-c624-4cf4-b607-0d0cc3d4ad4b None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.918221 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.918907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.919190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.919461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.920140 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.922107 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.941174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1382/2787] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:32 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:32.945271 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.955372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588f3ba-ad4a-4218-a3f9-b8bd11381569 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.959958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.960612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.960899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.961178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:32.961958 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:32.964070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:32.974280 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1406/2788] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:32.978149 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:32.988203 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a2eee-7e45-454e-923a-1f24cfbb8ae1 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:32.992818 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:32.993709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:32.993989 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:32.994263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] PATH_INFO: `/v3/projects/f194c697f5ce4803b4db951ea52809a8/users/9d06fdfa4d934edc8f8f42b09ae03bae/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.008027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f194c697f5ce4803b4db951ea52809a8, user_id=9d06fdfa4d934edc8f8f42b09ae03bae, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:33.010727 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:33.026619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1383/2789] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:32 2022] PUT /identity/v3/projects/f194c697f5ce4803b4db951ea52809a8/users/9d06fdfa4d934edc8f8f42b09ae03bae/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:33.030920 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:33.041568 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9012c-0794-478a-b499-27f081c1d887 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:33.096415 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:33.097024 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.097342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.097617 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.098339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:33.099942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130286ba-f03c-4ba3-92bf-db554e623cb0 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:33.110284 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1407/2790] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 22:29:33.114556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:33.124857 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc4e1c-4590-4ebd-9995-3faea76da843 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:33.129807 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:33.130780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.131130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.131410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] PATH_INFO: `/v3/projects/f194c697f5ce4803b4db951ea52809a8/users/9d06fdfa4d934edc8f8f42b09ae03bae/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.133887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f194c697f5ce4803b4db951ea52809a8, user_id=9d06fdfa4d934edc8f8f42b09ae03bae, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:33.138522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:33.150929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1384/2791] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:33 2022] PUT /identity/v3/projects/f194c697f5ce4803b4db951ea52809a8/users/9d06fdfa4d934edc8f8f42b09ae03bae/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:33.162231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.162528 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.162810 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.187734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] MFA Rules not processed for user `9d06fdfa4d934edc8f8f42b09ae03bae`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:33.188935 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:33.252241 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1408/2792] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:33.263983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:33.265710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:33.319899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972128e3-f6b9-4eb5-acb6-64b2292ae224 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:33.324258 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:33.324895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.325180 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.325483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.334274 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:33.335699 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ed5ff-c358-44a3-ac7f-65e7359ccc45 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:33.345833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1385/2793] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:33.720771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:33.779851 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bab6a-9c5c-477f-bdf0-a9f8ac396615 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:33.784326 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:33.785191 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.785517 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.785797 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] PATH_INFO: `/v3/users/d1e82ad824844baa90d3b9fe9d1ab34f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.786975 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e82ad824844baa90d3b9fe9d1ab34f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:33.788912 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:33.833386 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e82ad824844baa90d3b9fe9d1ab34f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:33.840236 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e82ad824844baa90d3b9fe9d1ab34f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:33.847243 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e82ad824844baa90d3b9fe9d1ab34f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:33.847857 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e82ad824844baa90d3b9fe9d1ab34f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:33.859616 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e82ad824844baa90d3b9fe9d1ab34f'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:33.865359 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1409/2794] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:33 2022] DELETE /identity/v3/users/d1e82ad824844baa90d3b9fe9d1ab34f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:33.870428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:33.870720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:33.871003 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:33.887891 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:33.889382 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:33.945103 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1386/2795] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:33.954768 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:33.956166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:34.012173 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bd74-4514-4fbf-abbd-73210b6604fd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:34.016084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:34.016723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:34.017004 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:34.017316 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:34.026668 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:34.028133 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:34.038155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1410/2796] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:34.302131 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:34.303593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:34.315993 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5e47f-07c9-46a3-944a-9d7b24c09f5e None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:34.320556 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:34.321445 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:34.321752 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:34.322630 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] PATH_INFO: `/v3/projects/e4d5e01ee7e84c26836f6f87f8b90b25` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:34.323813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5e01ee7e84c26836f6f87f8b90b25)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:34.325903 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:34.372627 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5e01ee7e84c26836f6f87f8b90b25', 'request_id': 'req-80b37a92-0c9d-4926-902e-e86ed907aa83'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.378463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5e01ee7e84c26836f6f87f8b90b25', 'request_id': 'req-80b37a92-0c9d-4926-902e-e86ed907aa83'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.388437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5e01ee7e84c26836f6f87f8b90b25', 'request_id': 'req-80b37a92-0c9d-4926-902e-e86ed907aa83'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.400674 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] The token cache is being invalidate because project e4d5e01ee7e84c26836f6f87f8b90b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:34.400960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.401633 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.403441 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1387/2797] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:34 2022] DELETE /identity/v3/projects/e4d5e01ee7e84c26836f6f87f8b90b25 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:34.407557 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:34.417837 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba92a23-57ee-4d0c-86d0-1c3b8e74d905 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:34.489036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:34.489952 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:34.490239 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:34.490663 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] PATH_INFO: `/v3/users/9d06fdfa4d934edc8f8f42b09ae03bae` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:34.491900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d06fdfa4d934edc8f8f42b09ae03bae)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:34.494397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:34.542229 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d06fdfa4d934edc8f8f42b09ae03bae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.548771 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d06fdfa4d934edc8f8f42b09ae03bae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.555718 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d06fdfa4d934edc8f8f42b09ae03bae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.556861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d06fdfa4d934edc8f8f42b09ae03bae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.568179 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-a516a2bb-2d07-4606-b411-50a60591ca06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d06fdfa4d934edc8f8f42b09ae03bae'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.574502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1411/2798] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:34 2022] DELETE /identity/v3/users/9d06fdfa4d934edc8f8f42b09ae03bae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:34.832269 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:34.834170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:34.851327 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b37a92-0c9d-4926-902e-e86ed907aa83 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:34.906167 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:34.907021 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:34.907302 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:34.907574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] PATH_INFO: `/v3/projects/f194c697f5ce4803b4db951ea52809a8` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:34.908724 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f194c697f5ce4803b4db951ea52809a8)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:34.910715 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:34.955051 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f194c697f5ce4803b4db951ea52809a8', 'request_id': 'req-6f41dbbb-706c-4975-82ed-ccea646ab7eb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.960204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f194c697f5ce4803b4db951ea52809a8', 'request_id': 'req-6f41dbbb-706c-4975-82ed-ccea646ab7eb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.967170 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f194c697f5ce4803b4db951ea52809a8', 'request_id': 'req-6f41dbbb-706c-4975-82ed-ccea646ab7eb'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.977756 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] The token cache is being invalidate because project f194c697f5ce4803b4db951ea52809a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:34.978554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.979228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-6f41dbbb-706c-4975-82ed-ccea646ab7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:34.981387 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1388/2799] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:34 2022] DELETE /identity/v3/projects/f194c697f5ce4803b4db951ea52809a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:34.986242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:34.986723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:34.986841 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.004735 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:35.006006 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:35.065342 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1412/2800] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:35.072901 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.073190 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.073504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.092739 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:35.094006 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:35.101765 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1389/2801] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:35.106650 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.116418 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3f167-2be8-424d-8886-b716321f94c9 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.121050 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.121796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.122082 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.122364 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.123093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:35.123403 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.125001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.136154 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1413/2802] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:35.140611 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.151316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef60fa-f3ae-42f6-98aa-b423d74ff0cc None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.158301 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.158960 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.159245 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.159522 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.160217 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.162178 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.191494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1390/2803] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:35.196404 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.207854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246a5f8-ad69-41fd-9bea-dea9bd16d3b1 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.262115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.262782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.263070 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.263354 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.264294 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.266260 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.284962 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1414/2804] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/users => generated 279 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:35.289020 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.299671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74051ffe-47bb-4585-959a-a8028b3347f8 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.304309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.305012 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.305330 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.305608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.306354 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.307932 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.317885 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1391/2805] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:35.321684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.331120 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf22e9-58d6-4efa-83e0-329af31048d6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.335969 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.336613 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.336892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.337166 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.338413 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.340001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986eff0-0d69-4f77-8378-5749c2a3db9d admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.349765 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1415/2806] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:35.354298 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.364282 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046d15-f298-4f01-b57b-c6616253b0d7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.369286 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.370147 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.370426 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.370704 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] PATH_INFO: `/v3/projects/0c82701780c34413a6b5a11e0858e78d/users/3f9f3fef4e884b85ba562708c9490cd2/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.385124 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c82701780c34413a6b5a11e0858e78d, user_id=3f9f3fef4e884b85ba562708c9490cd2, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.387781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.400856 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1392/2807] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:35 2022] PUT /identity/v3/projects/0c82701780c34413a6b5a11e0858e78d/users/3f9f3fef4e884b85ba562708c9490cd2/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:35.410921 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.411216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.411494 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.437275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] MFA Rules not processed for user `3f9f3fef4e884b85ba562708c9490cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:35.438484 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:35.502629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1416/2808] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:35.507031 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.576174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6b9e-dc18-4685-ba75-7df74544ac8b admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.580775 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.581532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.581813 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.582085 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.582777 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.584668 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.609266 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1393/2809] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:35.613456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.623873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87162-696c-4a22-916b-e9f4905d79e6 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.677427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.678086 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.678369 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.678647 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.679338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.681890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.703698 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1417/2810] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:35.705014 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.715977 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470dcd5-9359-4d10-8091-65b3d203cc85 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.720606 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.721284 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.721571 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.721848 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.722558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.724151 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.734713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1394/2811] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:35.738789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.749094 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd612f-3ef9-4d22-a98c-266ef8ba0a47 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.753805 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.754629 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.754936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.755188 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] PATH_INFO: `/v3/projects/6d9a978dc484470b85cccf020fd27f2d/users/76ef9fd663ed4d60aa861a96b2588639/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.772773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9a978dc484470b85cccf020fd27f2d, user_id=76ef9fd663ed4d60aa861a96b2588639, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.775539 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.789457 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1418/2812] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:35 2022] PUT /identity/v3/projects/6d9a978dc484470b85cccf020fd27f2d/users/76ef9fd663ed4d60aa861a96b2588639/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:35.793638 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.803768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e02c29-b6c6-4601-aab2-5c0ca69a3053 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.857850 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.858504 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.858786 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.859052 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.859755 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.861356 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab1df-d411-4def-a000-ff4fe6375578 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.870987 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1395/2813] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:35.875374 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:35.886178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133c654-2b76-4a0d-8bb3-db480ddc17e7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:35.891178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:35.892054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.892341 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.892621 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] PATH_INFO: `/v3/projects/6d9a978dc484470b85cccf020fd27f2d/users/76ef9fd663ed4d60aa861a96b2588639/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.894619 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9a978dc484470b85cccf020fd27f2d, user_id=76ef9fd663ed4d60aa861a96b2588639, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:35.897331 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:35.907416 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1419/2814] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:35 2022] PUT /identity/v3/projects/6d9a978dc484470b85cccf020fd27f2d/users/76ef9fd663ed4d60aa861a96b2588639/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:35.918349 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:35.918666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:35.918944 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:35.945083 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] MFA Rules not processed for user `76ef9fd663ed4d60aa861a96b2588639`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:35.946316 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:36.010444 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1396/2815] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:36.021742 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:36.023467 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:36.078492 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3e4a-75ea-4b40-babc-cabc49990daf admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:36.082168 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:36.082818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:36.083101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:36.083379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:36.092196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:36.093680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:36.103502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1420/2816] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:36.185114 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:36.194458 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959b6ff-68aa-4c14-907d-2ce7a0a1ef09 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:36.198105 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:36.198731 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:36.199011 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:36.199285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:36.253434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:36.254860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546097c-866c-49cb-80dc-85a247e75334 service cinder] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:36.263582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1397/2817] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:50.916760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:50.974662 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50e3e9-dd4c-4cdf-a9c8-4c23805e0a28 service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:50.979761 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:50.980610 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:50.980890 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:50.981164 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] PATH_INFO: `/v3/users/3f9f3fef4e884b85ba562708c9490cd2` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:50.982356 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9f3fef4e884b85ba562708c9490cd2)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:50.984287 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:51.026334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9f3fef4e884b85ba562708c9490cd2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.032824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9f3fef4e884b85ba562708c9490cd2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.039612 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9f3fef4e884b85ba562708c9490cd2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.040878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9f3fef4e884b85ba562708c9490cd2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.053083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9f3fef4e884b85ba562708c9490cd2'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.058778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1421/2818] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:50 2022] DELETE /identity/v3/users/3f9f3fef4e884b85ba562708c9490cd2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:51.063283 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:51.063762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:51.063859 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:51.079975 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:51.081159 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:51.136216 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1398/2819] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:51.146052 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:51.147444 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:51.209796 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e5f5-5449-438c-b575-bfc777bcd271 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:51.214227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:51.214878 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:51.215161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:51.215438 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:51.224420 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:51.225888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:51.235081 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1422/2820] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:51.486358 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:51.487793 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:51.499990 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931778b-48d8-4ffa-8ce1-2309ab3d28e6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:51.504534 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:51.505439 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:51.505720 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:51.505995 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] PATH_INFO: `/v3/projects/0c82701780c34413a6b5a11e0858e78d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:51.507173 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c82701780c34413a6b5a11e0858e78d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:51.509781 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:51.563473 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c82701780c34413a6b5a11e0858e78d', 'request_id': 'req-2182cfe6-cc63-4214-b4cf-e40cab660dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.568615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c82701780c34413a6b5a11e0858e78d', 'request_id': 'req-2182cfe6-cc63-4214-b4cf-e40cab660dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.575609 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c82701780c34413a6b5a11e0858e78d', 'request_id': 'req-2182cfe6-cc63-4214-b4cf-e40cab660dd4'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.586453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] The token cache is being invalidate because project 0c82701780c34413a6b5a11e0858e78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:51.586734 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.587406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.588941 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1399/2821] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:51 2022] DELETE /identity/v3/projects/0c82701780c34413a6b5a11e0858e78d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:51.592948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:51.602427 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f757421-6fe0-431c-9276-0e0bcaa6e22c service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:51.656585 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:51.657594 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:51.657877 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:51.658150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] PATH_INFO: `/v3/users/76ef9fd663ed4d60aa861a96b2588639` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:51.659340 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ef9fd663ed4d60aa861a96b2588639)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:51.661414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:51.707372 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ef9fd663ed4d60aa861a96b2588639'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.713900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ef9fd663ed4d60aa861a96b2588639'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.720730 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ef9fd663ed4d60aa861a96b2588639'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.721371 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ef9fd663ed4d60aa861a96b2588639'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.732593 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-ca99c888-d6f8-4808-b78d-c535f422e051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ef9fd663ed4d60aa861a96b2588639'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:51.738210 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1423/2822] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:51 2022] DELETE /identity/v3/users/76ef9fd663ed4d60aa861a96b2588639 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:52.001419 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.002907 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:52.016193 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182cfe6-cc63-4214-b4cf-e40cab660dd4 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.072295 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.073158 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.073472 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.073749 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] PATH_INFO: `/v3/projects/6d9a978dc484470b85cccf020fd27f2d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.074918 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9a978dc484470b85cccf020fd27f2d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.076812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.121139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9a978dc484470b85cccf020fd27f2d', 'request_id': 'req-b8f8db6e-bb52-4a62-afef-97c98da77cb6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:52.126290 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9a978dc484470b85cccf020fd27f2d', 'request_id': 'req-b8f8db6e-bb52-4a62-afef-97c98da77cb6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:52.132789 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9a978dc484470b85cccf020fd27f2d', 'request_id': 'req-b8f8db6e-bb52-4a62-afef-97c98da77cb6'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:52.143386 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] The token cache is being invalidate because project 6d9a978dc484470b85cccf020fd27f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79844) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:52.143672 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:52.144383 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b8f8db6e-bb52-4a62-afef-97c98da77cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:52.146122 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1400/2823] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:52 2022] DELETE /identity/v3/projects/6d9a978dc484470b85cccf020fd27f2d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:52.151323 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.151873 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.152118 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.170903 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:52.172097 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:52.226733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1424/2824] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:52.235120 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.235410 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.235688 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.254215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:52.255392 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:52.263138 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1401/2825] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:52.267576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.277569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8aef4-c3a0-4eb6-b75b-22604f9a20c3 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.282084 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.282723 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.283003 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.283275 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] PATH_INFO: `/v3/domains` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.283990 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79845) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:52.284292 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.285938 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.297443 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1425/2826] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:52.301475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.310552 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fcda3-7331-4328-848b-a51894acdae0 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.315255 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.315892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.316174 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.316449 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.317139 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.319054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.343654 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1402/2827] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:52.348085 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.359080 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e66e8-db78-4e4f-8e62-bc734ead5392 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.412384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.413054 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.413379 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.413659 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.414338 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.416831 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.435425 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1426/2828] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:29:52.439700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.450088 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063927e3-518d-4bbd-b79e-bbd3be3e7805 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.454675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.455325 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.455608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.455897 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.456624 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.458250 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.468728 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1403/2829] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:52.472513 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.482784 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895db0e-e6d5-4244-95b4-c0e20bca4520 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.487451 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.488104 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.488394 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.488680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.489441 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.491036 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd63fa-d2ea-4428-993b-c47a12695776 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.500595 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1427/2830] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:52.504453 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.514257 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316073-2cc8-457b-8910-906b227928a7 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.518796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.519651 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.519930 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.520202 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] PATH_INFO: `/v3/projects/8e7365a731b24406ab7825c7713f6ea6/users/ce819a6140bd4123af972d1ac5d4757b/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.534495 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7365a731b24406ab7825c7713f6ea6, user_id=ce819a6140bd4123af972d1ac5d4757b, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.537157 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.550153 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1404/2831] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:52 2022] PUT /identity/v3/projects/8e7365a731b24406ab7825c7713f6ea6/users/ce819a6140bd4123af972d1ac5d4757b/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:52.561270 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.561569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.561852 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.587434 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] MFA Rules not processed for user `ce819a6140bd4123af972d1ac5d4757b`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:52.588639 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:52.650965 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1428/2832] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:52.655350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.714054 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03605990-1711-46bf-a24f-56cb7f7ad6b6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.718676 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.719321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.719604 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.719878 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.720558 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.722488 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.747061 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1405/2833] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:52.751083 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.762249 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec24c4-587b-4578-8df5-01a6e9d9cee5 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.818452 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.819124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.819411 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.819691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] PATH_INFO: `/v3/users` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.820382 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.822818 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.842654 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1429/2834] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:52 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:52.846543 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.856468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c5394-02bf-4c16-9155-0e95d68badf8 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.862285 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.862934 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.863212 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.863484 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.864204 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.867113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.879263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1406/2835] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:52.883507 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.897231 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512bbf-7fc4-4513-8af1-6d96a2cff739 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.902511 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:52.903383 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:52.903667 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:52.903943 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] PATH_INFO: `/v3/projects/e92f0aacddd4451792084c93b3f1e840/users/b1c4a3c117674b849ecb5c9957b11011/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:52.918046 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92f0aacddd4451792084c93b3f1e840, user_id=b1c4a3c117674b849ecb5c9957b11011, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:52.920704 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:52.933911 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1430/2836] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:52 2022] PUT /identity/v3/projects/e92f0aacddd4451792084c93b3f1e840/users/b1c4a3c117674b849ecb5c9957b11011/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:52.937809 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:52.947954 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4718-3edd-43fe-8203-690b4763f402 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:52.999970 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.000618 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.000899 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.001171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.001900 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.003476 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a626d-b8c2-494e-a34b-c4f0ad54b376 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.013230 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1407/2837] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:53.017502 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.027537 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aba35-8d1f-42f1-ad9a-a67bf9553931 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.032119 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.032992 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.033306 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.033587 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] PATH_INFO: `/v3/projects/e92f0aacddd4451792084c93b3f1e840/users/b1c4a3c117674b849ecb5c9957b11011/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.035534 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92f0aacddd4451792084c93b3f1e840, user_id=b1c4a3c117674b849ecb5c9957b11011, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.038230 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.048268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1431/2838] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:53 2022] PUT /identity/v3/projects/e92f0aacddd4451792084c93b3f1e840/users/b1c4a3c117674b849ecb5c9957b11011/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:53.107109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.107694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.107694 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.134525 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] MFA Rules not processed for user `b1c4a3c117674b849ecb5c9957b11011`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:53.135764 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:53.208405 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1408/2839] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:53.220370 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.222161 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:53.278019 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f584a-fadb-4d57-8e6d-e097a761cd05 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.281611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e8bbada4fbb48a186e373ac378e1fda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.282247 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.282533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.282808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.291508 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.292948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.302111 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1432/2840] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:53.598320 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.607763 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf0e35-99d6-4364-b9c1-562b8b3b7895 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.612338 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4a3c117674b849ecb5c9957b11011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92f0aacddd4451792084c93b3f1e840', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.612984 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.613307 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.613587 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.614299 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:53.614605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.616192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.627833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1409/2841] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:53.631753 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.640942 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1976c-f084-4676-ac4c-4d531a8d449c service cinder] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.645503 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4a3c117674b849ecb5c9957b11011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92f0aacddd4451792084c93b3f1e840', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.646159 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.646431 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.646709 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.647388 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.649309 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.674150 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1433/2842] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:53 2022] POST /identity/v3/projects => generated 353 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:53.677546 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.687684 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3cd02-2a57-48b2-9ba8-cc8d04b7e8dd tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.739663 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4a3c117674b849ecb5c9957b11011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92f0aacddd4451792084c93b3f1e840', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.740309 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.740594 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.740871 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.741615 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:53.741947 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.744148 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.754780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1410/2843] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:53.794235 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:53.806363 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10970243-98d0-40a2-8489-a364aa80634b tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:53.811055 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1c4a3c117674b849ecb5c9957b11011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92f0aacddd4451792084c93b3f1e840', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:53.811966 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:53.812204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:53.812482 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] PATH_INFO: `/v3/projects/cb3844d019a544bfabca427d4022038e` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:53.813804 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb3844d019a544bfabca427d4022038e)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:53.815760 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:53.862598 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3844d019a544bfabca427d4022038e', 'request_id': 'req-623abef2-54a6-4218-8511-ddd68e4cb1a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:53.868963 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3844d019a544bfabca427d4022038e', 'request_id': 'req-623abef2-54a6-4218-8511-ddd68e4cb1a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:53.874290 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3844d019a544bfabca427d4022038e', 'request_id': 'req-623abef2-54a6-4218-8511-ddd68e4cb1a9'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:53.885899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] The token cache is being invalidate because project cb3844d019a544bfabca427d4022038e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:53.886190 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:53.886833 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-623abef2-54a6-4218-8511-ddd68e4cb1a9 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:53.888358 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1434/2844] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:53 2022] DELETE /identity/v3/projects/cb3844d019a544bfabca427d4022038e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:54.068921 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:54.070679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:54.132406 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ce19-b4ff-497a-95f7-d29289a4caa7 tempest-VolumeQuotaClassesTest-179182911 tempest-VolumeQuotaClassesTest-179182911-project-admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:54.188113 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:54.188982 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:54.189296 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:54.189595 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] PATH_INFO: `/v3/users/ce819a6140bd4123af972d1ac5d4757b` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:54.190757 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce819a6140bd4123af972d1ac5d4757b)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:54.192679 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:54.237737 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce819a6140bd4123af972d1ac5d4757b'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.245876 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce819a6140bd4123af972d1ac5d4757b'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.252554 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce819a6140bd4123af972d1ac5d4757b'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.253215 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce819a6140bd4123af972d1ac5d4757b'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.253833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce819a6140bd4123af972d1ac5d4757b'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.270867 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1411/2845] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:54 2022] DELETE /identity/v3/users/ce819a6140bd4123af972d1ac5d4757b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:54.275948 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:54.276408 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:54.276506 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:54.293498 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:54.294719 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:54.351524 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1435/2846] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:54.362098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:54.363521 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:54.419041 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e6c8e-1d9f-4b08-9a5d-b749ed57972f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:54.422703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:54.423341 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:54.423625 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:54.423902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:54.432776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:54.434223 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:54.443415 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1412/2847] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:54.702588 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:54.704102 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:54.716205 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82484342-feeb-4b06-a1ce-fd8bbbcc125b None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:54.721139 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:54.722135 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:54.722450 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:54.722789 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] PATH_INFO: `/v3/projects/8e7365a731b24406ab7825c7713f6ea6` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:54.724170 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7365a731b24406ab7825c7713f6ea6)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:54.726560 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:54.771674 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7365a731b24406ab7825c7713f6ea6', 'request_id': 'req-45a940d2-e659-4287-ba71-6d1df75d3301'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.777526 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7365a731b24406ab7825c7713f6ea6', 'request_id': 'req-45a940d2-e659-4287-ba71-6d1df75d3301'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.782697 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7365a731b24406ab7825c7713f6ea6', 'request_id': 'req-45a940d2-e659-4287-ba71-6d1df75d3301'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.794101 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] The token cache is being invalidate because project 8e7365a731b24406ab7825c7713f6ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:54.794391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.795011 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.796554 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1436/2848] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:54 2022] DELETE /identity/v3/projects/8e7365a731b24406ab7825c7713f6ea6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:54.802500 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:54.812904 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578712f-0741-4e8c-8c3e-7cf7b86af335 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:54.870544 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:54.871422 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:54.871709 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:54.871985 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] PATH_INFO: `/v3/users/b1c4a3c117674b849ecb5c9957b11011` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:54.873176 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c4a3c117674b849ecb5c9957b11011)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:54.875123 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:54.919095 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c4a3c117674b849ecb5c9957b11011'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.925847 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c4a3c117674b849ecb5c9957b11011'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.932929 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c4a3c117674b849ecb5c9957b11011'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.933560 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c4a3c117674b849ecb5c9957b11011'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.934197 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-a7513614-55ee-44f7-9e04-66b42d7eb843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c4a3c117674b849ecb5c9957b11011'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:54.950762 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1413/2849] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:29:54 2022] DELETE /identity/v3/users/b1c4a3c117674b849ecb5c9957b11011 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:29:55.211435 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.213892 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:55.229700 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a940d2-e659-4287-ba71-6d1df75d3301 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.284367 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.285242 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.285530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.285808 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] PATH_INFO: `/v3/projects/e92f0aacddd4451792084c93b3f1e840` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.286977 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92f0aacddd4451792084c93b3f1e840)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.288888 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.332293 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92f0aacddd4451792084c93b3f1e840', 'request_id': 'req-5556384b-9f38-41f5-a1f1-0da910c80ca7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:55.338653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92f0aacddd4451792084c93b3f1e840', 'request_id': 'req-5556384b-9f38-41f5-a1f1-0da910c80ca7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:55.344001 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92f0aacddd4451792084c93b3f1e840', 'request_id': 'req-5556384b-9f38-41f5-a1f1-0da910c80ca7'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:55.356304 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] The token cache is being invalidate because project e92f0aacddd4451792084c93b3f1e840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:29:55.356576 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:55.357184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-5556384b-9f38-41f5-a1f1-0da910c80ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:29:55.358782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1437/2850] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:29:55 2022] DELETE /identity/v3/projects/e92f0aacddd4451792084c93b3f1e840 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:55.366475 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.366957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.367058 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.384226 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:55.385483 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:55.440833 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1414/2851] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:55.448737 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.449029 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.449433 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.468051 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:55.469178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:55.476939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1438/2852] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:55.481614 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.490992 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bf970-c428-47e5-8cf9-edd7e5d12b72 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.495591 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.496239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.496524 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.496801 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] PATH_INFO: `/v3/domains` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.497555 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79844) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 22:29:55.497861 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.499461 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.510574 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1415/2853] 10.222.0.13 () {58 vars in 1152 bytes} [Mon May 16 22:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 22:29:55.514978 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.523973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c4920-6291-42eb-9baf-96559c3bb689 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.529043 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.529710 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.529993 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.530268 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.530973 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.532848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.558100 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1439/2854] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:55 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:55.562164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.571812 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f64d-b8f5-4011-a654-750f3f6ac78f admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.625582 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.626239 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.626520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.626792 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.627494 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.629541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.648780 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1416/2855] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:55 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:55.653563 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.663519 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c96d-9752-429f-8aa4-6232e36d1b5b admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.668124 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.668773 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.669060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.669376 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.670099 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.671684 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.681696 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1440/2856] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:55.685463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.694902 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34addd93-3893-41e2-9117-b8b348e5ed6c admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.699953 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.700585 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.700865 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.701137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.701877 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.703434 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf907b-2260-43d9-8d1f-a0c0bd6746e6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.713657 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1417/2857] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:29:55.717504 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.727131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b342ba-ae23-4425-99e7-19c5420fa633 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.731999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.732908 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.733225 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.733509 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] PATH_INFO: `/v3/projects/80bf166118c44c71a212628dbcaaf17c/users/87ea243271954fd7ade0c9fb21beebc0/roles/c64fac755de048df8f44054c01499e8f` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.747882 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bf166118c44c71a212628dbcaaf17c, user_id=87ea243271954fd7ade0c9fb21beebc0, role_id=c64fac755de048df8f44054c01499e8f)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.750604 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.764215 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1441/2858] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:29:55 2022] PUT /identity/v3/projects/80bf166118c44c71a212628dbcaaf17c/users/87ea243271954fd7ade0c9fb21beebc0/roles/c64fac755de048df8f44054c01499e8f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:29:55.769317 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35c99-7613-44c8-a2ac-d45e2062ce07 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.769617 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35c99-7613-44c8-a2ac-d45e2062ce07 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.769895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb35c99-7613-44c8-a2ac-d45e2062ce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.787547 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ecb35c99-7613-44c8-a2ac-d45e2062ce07 None None] MFA Rules not processed for user `b080d4f8faa8436f9ca4b9fb89dd515d`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:55.788746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ecb35c99-7613-44c8-a2ac-d45e2062ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:55.845104 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1418/2859] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:55.854782 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:55.856456 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:55.910827 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e4065-cbf2-42e0-a3b5-30ebe03702a7 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:55.914468 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:55.915115 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:55.915384 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:55.915849 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:55.927317 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:55.928793 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:55.938224 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1442/2860] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:29:59.711402 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:59.712562 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:59.712798 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:59.739360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.auth.core [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] MFA Rules not processed for user `87ea243271954fd7ade0c9fb21beebc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79844) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:29:59.740517 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:29:59.807768 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1419/2861] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:29:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:29:59.812381 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:59.822824 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35474bb5-399f-4697-890f-bc3d2b128bff service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:59.827562 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:59.836227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:59.836227 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:59.841705 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:59.842690 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:59.844645 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:59.874184 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1443/2862] 10.222.0.13 () {60 vars in 1152 bytes} [Mon May 16 22:29:59 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 22:29:59.878312 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:59.895605 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955a82-5c6a-4936-a8bd-b3f9916851d6 None None] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:59.953184 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:59.953894 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:59.954280 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:59.954557 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:59.955244 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:29:59.957171 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:29:59.977027 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1420/2863] 10.222.0.13 () {60 vars in 1143 bytes} [Mon May 16 22:29:59 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 22:29:59.981145 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:29:59.991981 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eebe6-d907-43db-b931-a78ae1a088c6 admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:29:59.997155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:29:59.997869 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:29:59.998157 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:29:59.998591 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:29:59.999339 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:00.000968 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:00.012736 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1444/2864] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:30:00.017403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:00.027863 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430555c-4326-43be-a9cd-c97b5dd89cf6 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:00.033192 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:00.034152 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:00.034437 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:00.034710 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] PATH_INFO: `/v3/projects/57ebc7e25fa840c38401d95b264e648b/users/62436138cdf04570a34663033de927c8/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:00.050805 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ebc7e25fa840c38401d95b264e648b, user_id=62436138cdf04570a34663033de927c8, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:00.053545 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:00.069009 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1421/2865] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:30:00 2022] PUT /identity/v3/projects/57ebc7e25fa840c38401d95b264e648b/users/62436138cdf04570a34663033de927c8/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 22:30:00.073332 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:00.083391 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c568f-0d76-4b80-9c19-115929ec0c4a admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:00.140907 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:00.141637 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:00.141950 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:00.142248 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] PATH_INFO: `/v3/roles` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:00.143223 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:00.144856 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56458f-3ac9-482d-beba-3c447d0e948c admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:00.155348 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1445/2866] 10.222.0.13 () {58 vars in 1121 bytes} [Mon May 16 22:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 22:30:00.159350 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:00.173892 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f657daa-c83a-4ddf-97c1-db82077b91fe admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:00.179195 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:00.180098 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:00.180401 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:00.181194 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] PATH_INFO: `/v3/projects/57ebc7e25fa840c38401d95b264e648b/users/62436138cdf04570a34663033de927c8/roles/7f564e8d2a7c46639daf40035b442e0d` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:00.183227 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ebc7e25fa840c38401d95b264e648b, user_id=62436138cdf04570a34663033de927c8, role_id=7f564e8d2a7c46639daf40035b442e0d)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:00.185938 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:00.196366 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1422/2867] 10.222.0.13 () {60 vars in 1482 bytes} [Mon May 16 22:30:00 2022] PUT /identity/v3/projects/57ebc7e25fa840c38401d95b264e648b/users/62436138cdf04570a34663033de927c8/roles/7f564e8d2a7c46639daf40035b442e0d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:30:04.366936 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9cae1-9729-42cb-8bf7-8863a272b6f7 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:04.367414 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9cae1-9729-42cb-8bf7-8863a272b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:04.367530 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9cae1-9729-42cb-8bf7-8863a272b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:04.394899 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-f6f9cae1-9729-42cb-8bf7-8863a272b6f7 None None] MFA Rules not processed for user `62436138cdf04570a34663033de927c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:30:04.396117 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-f6f9cae1-9729-42cb-8bf7-8863a272b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:04.463321 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1446/2868] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:30:04.476503 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:04.478823 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:04.552619 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e15ee-c99c-4f49-a92e-a8d9200f6fbc admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:04.558241 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:04.558895 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:04.559182 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:04.559459 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:04.613825 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:04.615428 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:04.624893 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1423/2869] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:05.687093 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] REQUEST_METHOD: `POST` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:05.687473 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:05.687661 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:05.707098 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.auth.core [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] MFA Rules not processed for user `87ea243271954fd7ade0c9fb21beebc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79845) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 22:30:05.708322 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:05.716216 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1447/2870] 10.222.0.13 () {58 vars in 957 bytes} [Mon May 16 22:30:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 22:30:22.196099 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:22.251318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae05d-8a53-463a-bb3e-4c2c8e3a3362 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:22.256712 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:22.257860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:22.258351 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:22.258816 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:22.262808 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:22.274796 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:22.277666 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:22.287433 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1424/2871] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:22.724219 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:22.725733 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:22.805156 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a646-a8ea-46c3-b182-70575d461b80 None None] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:22.810763 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:22.811447 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:22.811734 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:22.812014 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:22.813785 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:22.825143 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:22.826755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:22.836577 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1448/2872] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:24.522261 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:24.523776 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:24.536328 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1059c6-981c-44af-acc9-94679ed97616 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:24.540592 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:24.541964 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:24.542252 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:24.542531 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:24.545049 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:24.557137 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:24.558925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:24.567869 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1425/2873] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:25.519140 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:25.520916 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:25.546397 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741a7d8-36cf-43b2-8812-d96bf2290b20 service placement] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:25.552192 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:25.552861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:25.553148 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:25.553477 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:25.558412 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:25.573567 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:25.575196 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:25.589060 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1449/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:34.564700 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:34.577842 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62502f94-4791-44e0-8d7d-4eb8df7e2d61 service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:34.583318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:34.583957 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:34.584235 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:34.584505 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:34.586293 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:34.598887 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:34.600452 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:34.611403 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1426/2875] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:37.348007 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:37.357254 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f453b-9eb7-4d39-8926-e72c730d7625 service nova] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:37.360778 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:37.361437 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:37.361721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:37.361999 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:37.371282 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:37.372714 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:37.381941 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1450/2876] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:30:39.186373 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:30:39.197532 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73b5d-4570-4eeb-8175-75b31a98d656 service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:30:39.204043 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd2eb7a2de50414587c7bd815d401959', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:30:39.204696 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:30:39.204983 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:30:39.205287 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:30:39.207094 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:30:39.219665 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:30:39.221263 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:30:39.232881 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1427/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:30:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:32:24.746876 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:32:24.748269 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:32:24.829409 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c3d4e-cc2c-4095-92f3-a310aa101972 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:32:24.834483 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:32:24.835126 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:32:24.835406 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:32:24.835677 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:32:24.837611 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:32:24.848861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:32:24.850471 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:32:24.860641 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1451/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:32:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:32:51.967053 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:32:52.003035 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffb51c-2b8e-4007-ae9c-d7588aed3d9b service nova] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:32:52.006687 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:32:52.007321 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:32:52.007601 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:32:52.007872 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:32:52.010268 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:32:52.032925 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:32:52.035071 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:32:52.043224 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1428/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:32:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:32:52.154934 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:32:52.165533 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85649-bd95-4ca9-8585-59de141de25f service placement] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:32:52.169178 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:32:52.169848 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:32:52.170131 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:32:52.170407 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:32:52.172174 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:32:52.204755 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:32:52.206259 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:32:52.225631 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1452/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:32:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:34:23.977002 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:23.986675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c668d-138b-42f2-8e64-78aef89ac08b service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:23.990746 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:23.991526 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:23.991875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:23.992310 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:23.994575 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:34:24.009423 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:24.011713 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:24.023491 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1429/2881] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:34:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:34:25.196569 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:25.205189 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c108-28a1-4f16-9999-cd1cade9050f service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:25.208913 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86b0cbde93e04bc2832ec379ccc001c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:25.209596 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:25.209883 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:25.210160 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:25.211939 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:34:25.226234 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:25.227680 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:25.239516 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1453/2882] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 22:34:33.759866 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:33.840791 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f7eb-3f3c-4723-b65e-13266148c57c service neutron] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:33.845457 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:33.846355 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:33.846635 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:33.846910 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] PATH_INFO: `/v3/users/87ea243271954fd7ade0c9fb21beebc0` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:33.848130 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ea243271954fd7ade0c9fb21beebc0)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:33.850047 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:33.894463 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ea243271954fd7ade0c9fb21beebc0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:33.900924 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ea243271954fd7ade0c9fb21beebc0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:33.907593 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ea243271954fd7ade0c9fb21beebc0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:33.908228 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ea243271954fd7ade0c9fb21beebc0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:33.908860 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ea243271954fd7ade0c9fb21beebc0'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:33.925450 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1430/2883] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:34:33 2022] DELETE /identity/v3/users/87ea243271954fd7ade0c9fb21beebc0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:34:34.094866 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:34.111334 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0fb60-aa17-4a36-862c-cf5e0e73c9c9 service neutron] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:34.165721 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:34.166572 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:34.167417 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:34.167691 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] PATH_INFO: `/v3/projects/80bf166118c44c71a212628dbcaaf17c` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:34.168854 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bf166118c44c71a212628dbcaaf17c)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:34.170794 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:34.213078 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bf166118c44c71a212628dbcaaf17c', 'request_id': 'req-d0148908-143c-48ca-ac5f-4ed323f50bbd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.219638 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bf166118c44c71a212628dbcaaf17c', 'request_id': 'req-d0148908-143c-48ca-ac5f-4ed323f50bbd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.225034 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bf166118c44c71a212628dbcaaf17c', 'request_id': 'req-d0148908-143c-48ca-ac5f-4ed323f50bbd'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.248399 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] The token cache is being invalidate because project 80bf166118c44c71a212628dbcaaf17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:34:34.248713 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.249442 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.251031 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1454/2884] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:34:34 2022] DELETE /identity/v3/projects/80bf166118c44c71a212628dbcaaf17c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:34:34.254999 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:34.256520 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:34:34.269468 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4675f9-39fc-4aa0-831c-dce9c120df72 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:34.322719 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:34.323608 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:34.323890 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:34.324164 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] PATH_INFO: `/v3/users/62436138cdf04570a34663033de927c8` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:34.325367 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62436138cdf04570a34663033de927c8)` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:34.327318 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:34.369703 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62436138cdf04570a34663033de927c8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.376166 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62436138cdf04570a34663033de927c8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.382671 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62436138cdf04570a34663033de927c8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.383278 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62436138cdf04570a34663033de927c8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.383875 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.notifications [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62436138cdf04570a34663033de927c8'} {{(pid=79844) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.400675 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1431/2885] 10.222.0.13 () {58 vars in 1223 bytes} [Mon May 16 22:34:34 2022] DELETE /identity/v3/users/62436138cdf04570a34663033de927c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:34:34.571618 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Authenticating user token {{(pid=79845) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:34:34.573900 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.fernet_utils [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79845) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:34:34.586649 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148908-143c-48ca-ac5f-4ed323f50bbd admin admin] Validating token access rules against request {{(pid=79845) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:34:34.642155 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b080d4f8faa8436f9ca4b9fb89dd515d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d531649a1e149a58421310daa30d4f0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79845) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:34:34.642922 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:34:34.643204 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:34:34.643476 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] PATH_INFO: `/v3/projects/57ebc7e25fa840c38401d95b264e648b` {{(pid=79845) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:34:34.644636 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ebc7e25fa840c38401d95b264e648b)` {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:34:34.646633 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] RBAC: Authorization granted {{(pid=79845) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:34:34.691861 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ebc7e25fa840c38401d95b264e648b', 'request_id': 'req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.698387 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ebc7e25fa840c38401d95b264e648b', 'request_id': 'req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.703766 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ebc7e25fa840c38401d95b264e648b', 'request_id': 'req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1'} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.715724 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] The token cache is being invalidate because project 57ebc7e25fa840c38401d95b264e648b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79845) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 22:34:34.716041 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.716653 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: DEBUG keystone.notifications [None req-73c2bf3f-8819-4a8d-b8bc-54eba14e15b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79845) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 22:34:34.718238 dv-cinder-842000-1-iscsi devstack@keystone.service[79845]: [pid: 79845|app: 0|req: 1455/2886] 10.222.0.13 () {58 vars in 1232 bytes} [Mon May 16 22:34:34 2022] DELETE /identity/v3/projects/57ebc7e25fa840c38401d95b264e648b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 22:37:30.745701 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Authenticating user token {{(pid=79844) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 22:37:30.747109 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:37:30.813834 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae2763-ebc5-4583-9537-af510c7c4ac5 admin admin] Validating token access rules against request {{(pid=79844) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 22:37:30.872951 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6701f4de739740c080f6abec278ae940', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cf6048bb224fd5aedb9aae4b78d3ce', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79844) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 22:37:30.873629 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] REQUEST_METHOD: `GET` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 22:37:30.873942 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] SCRIPT_NAME: `/identity` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 22:37:30.874360 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79844) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 22:37:30.876132 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.fernet_utils [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79844) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 22:37:30.887541 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 22:37:30.889100 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73671-e078-4fca-91f2-c6bcdf035d09 service placement] RBAC: Authorization granted {{(pid=79844) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 22:37:30.899539 dv-cinder-842000-1-iscsi devstack@keystone.service[79844]: [pid: 79844|app: 0|req: 1432/2887] 10.222.0.13 () {60 vars in 1365 bytes} [Mon May 16 22:37:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)